00000001:02000400:3.0F:1788540783.383394:0:2970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788540804.646263:0:3192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788540807.123899:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 488 MB/s 00000001:01000000:2.0:1788540807.374306:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 523 MB/s 00000001:01000000:2.0:1788540807.624094:0:3251:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2795 MB/s 00000020:02000000:2.0:1788540808.789169:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g4093f3c 00000400:02000000:2.0:1788540810.135578:0:3298:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.159@tcp [8/256/0/180] 00008000:02000000:1.0F:1788540814.343135:0:3448:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1788540862.086495:0:5249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788540871.179604:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788540871.179610:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788540871.179746:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000dbee9412 00000080:02000400:3.0:1788540871.179758:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788540871.184069:0:5831:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788540871.184085:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788540871.184797:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000021ffe5c5) 00000020:00000080:2.0:1788540871.184817:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788540871.202722:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788540871.203178:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788540871.221030:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788540871.221063:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788540871.221080:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788540871.221123:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788540871.221144:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788540871.223058:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788540871.223070:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788540871.223086:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a71c 00000020:01000004:3.0:1788540871.223095:0:5831:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788540871.223100:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788540871.223105:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dbee9412 from MGS 00000020:01000004:3.0:1788540871.223109:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788540871.223138:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c0c5225f) 00000020:00000080:3.0:1788540871.223152:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788540871.223230:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dbee9412 from MGS, refs=2 00080000:01000000:3.0:1788540871.223235:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788540871.223239:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a72a 00000100:00100000:3.0:1788540871.223363:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788540871.223533:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788540871.223539:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788540871.224214:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788540871.224221:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788540871.224893:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788540871.225060:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788540871.225066:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788540871.225653:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788540871.225660:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788540871.225932:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788540871.225938:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788540871.226616:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540871.226619:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540871.226621:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540871.226882:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540871.226884:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540871.226886:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540871.227506:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788540871.232547:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788540871.478227:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2695 MB/s 00000001:01000000:2.0:1788540871.729375:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2430 MB/s 00000001:01000000:2.0:1788540871.979766:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 529 MB/s 00000001:01000000:2.0:1788540872.229817:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 583 MB/s 00080000:10000000:2.0:1788540872.245667:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1788540872.270292:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788540872.270318:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788540872.270321:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788540872.271802:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788540872.271978:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788540872.272019:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788540872.272238:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788540872.272263:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788540872.272890:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540872.273055:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788540872.273060:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788540872.273786:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788540872.273794:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788540872.274037:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788540872.274051:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788540872.275642:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788540872.277504:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.159@tcp' 00000020:01000004:3.0:1788540872.277509:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788540872.277561:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.159@tcp (typ=mgc) 00000020:00000080:3.0:1788540872.277573:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.159@tcp (00000000ace29070) 00000020:00000080:3.0:1788540872.277589:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788540872.277673:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000045c28c52@MGC192.168.202.159@tcp: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1788540872.277848:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.159@tcp-0 is initialized 00000040:01000000:3.0:1788540872.277854:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788540872.278651:0:5846:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1788540872.286638:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788540872.292949:0:5848:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788540872.293002:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.159@tcp (uuid 6c6c881b-c5d1-4767-bf18-6c64f558276e) 00000020:00000080:1.0:1788540872.293025:0:5831:0:(genops.c:1385:class_connect()) connect: client 6c6c881b-c5d1-4767-bf18-6c64f558276e, cookie 0xc9a6a13d3cd1a738 00000100:00080000:1.0:1788540872.293036:0:5831:0:(import.c:545:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540872.293041:0:5831:0:(import.c:665:import_select_connection()) MGC192.168.202.159@tcp: import 0000000045c28c52 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1788540872.293083:0:5831:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c3554c27 x1875420968386688/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788540872.293108:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS 00000020:01000004:1.0:1788540872.293127:0:5831:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788540872.293132:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788540872.293152:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d6c55b0a) 00000020:00000080:1.0:1788540872.293185:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788540872.293267:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c3554c27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c6c881b-c5d1-4767-bf18-6c64f558276e:3313:1875420968386688:0@lo:250: 00000100:00100000:0.0:1788540872.293521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540872.293594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968386688 00000100:00100000:0.0:1788540872.293602:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968386688 00000100:00100000:0.0:1788540872.293640:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540872.293646:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6a521f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1875420968386688:12345-0@lo:250: 00010000:00080000:0.0:1788540872.293669:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6c6c881b-c5d1-4767-bf18-6c64f558276e@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1788540872.293703:0:5842:0:(genops.c:1385:class_connect()) connect: client 6c6c881b-c5d1-4767-bf18-6c64f558276e, cookie 0xc9a6a13d3cd1a746 00000100:00080000:0.0:1788540872.293845:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000829e02b9 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540872.293910:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6a521f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:3313:x1875420968386688:12345-0@lo:250: Request processed in 262us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540872.293919:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540872.293970:0:3313:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788540872.293985:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.159@tcp: connect to target with instance 0 00000100:00080000:0.0:1788540872.293993:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788540872.293998:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788540872.294001:0:3313:0:(import.c:65:import_set_state_nolock()) 0000000045c28c52 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788540872.294004:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788540872.294008:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788540872.294013:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c3554c27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c6c881b-c5d1-4767-bf18-6c64f558276e:3313:1875420968386688:0@lo:250: 00000100:00100000:1.0:1788540872.302456:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788540872.302628:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788540872.302634:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788540872.306465:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788540872.306480:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788540872.306956:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788540872.306964:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788540872.307942:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788540872.308238:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788540872.308244:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788540872.308908:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788540872.308915:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788540872.351405:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788540872.351909:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788540872.351915:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788540872.358661:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788540872.358683:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788540872.359377:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540872.359592:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788540872.359596:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788540872.361951:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788540872.362108:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788540872.362977:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540872.363630:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788540872.363638:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788540872.368006:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788540872.368022:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788540872.368852:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540872.369031:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788540872.369037:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788540872.370601:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788540872.370616:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788540872.398695:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540872.398934:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788540872.398941:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788540872.406195:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788540872.406285:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788540872.407137:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788540872.407145:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788540872.408629:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788540872.408660:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788540872.408666:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788540872.408826:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788540872.408863:0:5831:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788540872.408867:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788540872.408869:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788540872.408870:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540872.408871:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540872.408872:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540872.408873:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540872.408878:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540872.408880:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788540872.408881:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540872.408882:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540872.408884:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540872.408885:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788540872.408887:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788540872.408889:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788540872.408890:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788540872.408890:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540872.408891:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540872.408892:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540872.408893:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540872.408894:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540872.408895:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788540872.408896:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540872.408896:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540872.408897:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540872.408898:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788540872.408934:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788540872.408952:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968386816:0@lo:253: 00000100:00100000:3.0:1788540872.409028:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.409122:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000084c707a3 going to sleep for 11 seconds 00000100:00100000:1.0:1788540872.411259:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968386816 00000100:00100000:1.0:1788540872.411274:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968386816 00000100:00100000:1.0:1788540872.411381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540872.411390:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffeffd05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5831:x1875420968386816:12345-0@lo:253: 20000000:01000000:1.0:1788540872.411594:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788540872.411598:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788540872.411883:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788540872.411943:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788540872.412304:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788540872.413257:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788540872.413594:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788540872.413598:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788540872.413603:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788540872.413606:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788540872.413621:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788540872.413813:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540872.414056:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788540872.414068:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788540872.414117:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788540872.414166:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788540872.414204:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788540872.414286:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788540872.414294:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788540872.414347:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788540872.414360:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788540872.414390:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788540872.414398:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788540872.414558:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788540872.414609:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788540872.414640:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788540872.414645:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788540872.414658:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540872.414864:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788540872.414873:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788540872.414906:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788540872.414940:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788540872.415003:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788540872.415013:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788540872.415077:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788540872.415085:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788540872.415127:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788540872.415163:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788540872.415210:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788540872.415221:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788540872.415309:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788540872.415318:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788540872.415347:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788540872.415376:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788540872.416741:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788540872.416805:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788540872.416813:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788540872.417732:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788540872.420308:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788540872.420347:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.159@tcp for mdt 20000000:01000000:3.0:1788540872.420349:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:3.0:1788540872.420386:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788540872.420394:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788540872.420466:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788540872.420475:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:3.0:1788540872.420521:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788540872.420531:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788540872.420562:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788540872.420616:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788540872.420677:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788540872.420681:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788540872.420684:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788540872.420698:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788540872.420700:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788540872.420729:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788540872.420731:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788540872.422705:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788540872.423154:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788540872.423205:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788540872.423239:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788540872.423252:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788540872.423254:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788540872.424015:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788540872.424334:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788540872.424374:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788540872.424631:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788540872.424647:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788540872.424649:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788540872.424653:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788540872.424655:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788540872.424661:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788540872.424668:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788540872.425004:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788540872.425184:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788540872.434771:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788540872.434824:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788540872.434898:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788540872.434964:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788540872.434985:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435000:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435067:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435071:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435075:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435079:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435083:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068c2afef already unused, calling callback (000000005668ae46) 00010000:00010000:3.0:1788540872.435085:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435090:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435099:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435103:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.435107:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068c2afef/0xc9a6a13d3cd1a74d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788540872.435119:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788540872.616201:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffeffd05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5831:x1875420968386816:12345-0@lo:253: Request processed in 204805us (207165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540872.616216:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540872.616298:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968386816:0@lo:253: 10000000:01000000:3.0:1788540872.616323:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788540872.616325:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788540872.616327:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788540872.616328:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540872.616329:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788540872.616330:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540872.616332:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540872.616333:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540872.616334:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788540872.616335:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788540872.616336:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540872.616337:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788540872.616353:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dbee9412 from lustre-MDT0000 10000000:01000000:3.0:1788540872.616374:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788540872.616377:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788540872.616380:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98d7b2f70000 10000000:01000000:3.0:1788540872.616384:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788540872.616390:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d7b2f70000 from 1 10000000:01000000:3.0:1788540872.616393:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788540872.616505:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.616515:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.616523:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540872.616538:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968386944:0@lo:101: 00000100:00100000:3.0:1788540872.616574:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.616673:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da010233 going to sleep for 11 seconds 00000100:00100000:2.0:1788540872.616790:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968386944 00000100:00100000:2.0:1788540872.616797:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968386944 00000100:00100000:2.0:1788540872.616868:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788540872.616877:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af3a708c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5831:x1875420968386944:12345-0@lo:101: 00010000:00010000:2.0:1788540872.616888:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540872.616901:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030e0575d/0xc9a6a13d3cd1a75b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a754 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540872.616931:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030e0575d/0xc9a6a13d3cd1a75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540872.616941:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030e0575d/0xc9a6a13d3cd1a75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540872.616949:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030e0575d, rc 0) 00000100:00100000:2.0:1788540872.616998:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af3a708c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:5831:x1875420968386944:12345-0@lo:101: Request processed in 123us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540872.617009:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540872.617070:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968386944:0@lo:101: 00010000:00010000:3.0:1788540872.617089:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.617097:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540872.617134:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387072:0@lo:501: 00000100:00100000:3.0:1788540872.617157:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.617281:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da010233 going to sleep for 11 seconds 00000100:00100000:0.0:1788540872.617352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387072 00000100:00100000:0.0:1788540872.617356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387072 00000100:00100000:0.0:1788540872.617380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788540872.617385:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0806e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:5831:x1875420968387072:12345-0@lo:501: 00000100:00100000:0.0:1788540872.617615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0806e4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:5831:x1875420968387072:12345-0@lo:501: Request processed in 230us (457us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788540872.617622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788540872.617692:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387072:0@lo:501: 10000000:01000000:3.0:1788540872.617709:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788540872.617723:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.617729:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 0000000068c2afef/0xc9a6a13d3cd1a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540872.617734:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d782e54800 10000000:01000000:3.0:1788540872.617737:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788540872.617739:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98d782e54800 10000000:01000000:3.0:1788540872.617740:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788540872.617742:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98d782e54800 from 1 10000000:01000000:3.0:1788540872.617743:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788540872.617766:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.617773:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.617799:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540872.617818:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387200:0@lo:101: 00000100:00100000:3.0:1788540872.617846:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540872.617869:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387200 00000100:00100000:1.0:1788540872.617873:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387200 00000100:00100000:3.0:1788540872.617883:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da010233 going to sleep for 11 seconds 00000100:00100000:1.0:1788540872.617966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540872.617974:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015aa0758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:5831:x1875420968387200:12345-0@lo:101: 00010000:00010000:1.0:1788540872.617982:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540872.617993:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009d706fd9/0xc9a6a13d3cd1a769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a762 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540872.618008:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d706fd9/0xc9a6a13d3cd1a769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a762 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540872.618017:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009d706fd9/0xc9a6a13d3cd1a769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a762 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540872.618196:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009d706fd9, rc 0) 00000100:00100000:1.0:1788540872.618243:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015aa0758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+7:5831:x1875420968387200:12345-0@lo:101: Request processed in 271us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540872.618249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788540872.618271:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387200:0@lo:101: 00010000:00010000:3.0:1788540872.618282:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.618289:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540872.618300:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788540872.618313:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.618319:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000596115f5/0xc9a6a13d3cd1a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540872.618323:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788540872.618327:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788540872.618330:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98d782e54800 10000000:01000000:3.0:1788540872.618331:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788540872.618333:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788540872.618335:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540872.618345:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.618353:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.618358:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540872.618365:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387328:0@lo:101: 00000100:00100000:3.0:1788540872.618385:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.618477:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da010233 going to sleep for 11 seconds 00000100:00100000:2.0:1788540872.618611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387328 00000100:00100000:2.0:1788540872.618615:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387328 00000100:00100000:2.0:1788540872.618676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540872.618683:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db397ddb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+7:5831:x1875420968387328:12345-0@lo:101: 00010000:00010000:2.0:1788540872.618690:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540872.618698:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eec1ce03/0xc9a6a13d3cd1a777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a770 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540872.618712:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eec1ce03/0xc9a6a13d3cd1a777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540872.618719:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eec1ce03/0xc9a6a13d3cd1a777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540872.618725:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eec1ce03, rc 0) 00000100:00100000:2.0:1788540872.618771:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db397ddb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+8:5831:x1875420968387328:12345-0@lo:101: Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540872.618777:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788540872.618833:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387328:0@lo:101: 00010000:00010000:3.0:1788540872.618842:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540872.618849:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540872.618887:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387456:0@lo:501: 00000100:00100000:3.0:1788540872.618922:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.619051:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da010233 going to sleep for 11 seconds 00000100:00100000:0.0:1788540872.619121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387456 00000100:00100000:0.0:1788540872.619126:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387456 00000100:00100000:0.0:1788540872.619144:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540872.619148:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004361dc36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+8:5831:x1875420968387456:12345-0@lo:501: 00000100:00100000:0.0:1788540872.619350:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004361dc36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5831:x1875420968387456:12345-0@lo:501: Request processed in 201us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540872.619357:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540872.619439:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387456:0@lo:501: 00000100:00100000:3.0:1788540872.619466:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387584:0@lo:503: 00000100:00100000:3.0:1788540872.619503:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.619528:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da010233 going to sleep for 11 seconds 00000100:00100000:0.0:1788540872.619636:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387584 00000100:00100000:0.0:1788540872.619641:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387584 00000100:00100000:0.0:1788540872.619658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540872.619662:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a73a7773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5831:x1875420968387584:12345-0@lo:503: 00000100:00100000:0.0:1788540872.619814:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a73a7773 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5831:x1875420968387584:12345-0@lo:503: Request processed in 152us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540872.619820:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788540872.619891:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387584:0@lo:503: 00000100:00100000:3.0:1788540872.620320:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5873:1875420968387712:0@lo:502: 00000100:00100000:3.0:1788540872.620360:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540872.620449:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ab7fa27 going to sleep for 11 seconds 00000100:00100000:2.0:1788540872.620551:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387712 00000100:00100000:2.0:1788540872.620556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387712 00000100:00100000:0.0:1788540872.620608:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540872.620616:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e40c7313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5873:x1875420968387712:12345-0@lo:502: 00000100:00100000:0.0:1788540872.620783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e40c7313 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5873:x1875420968387712:12345-0@lo:502: Request processed in 168us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540872.620790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540872.620925:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5873:1875420968387712:0@lo:502: 00000020:01000000:3.0:1788540872.620948:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540872.620959:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540872.620961:0:5873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788540872.620967:0:5873:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788540872.620970:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788540872.620983:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003b7047bc) 00000020:00000080:3.0:1788540872.621000:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788540872.621005:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788540872.621071:0:5873:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788540872.621079:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a785 00000020:00000080:3.0:1788540872.621275:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788540872.621279:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540872.621282:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540872.621284:0:5873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788540872.621286:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540872.621289:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540872.621290:0:5873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788540872.621293:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788540872.621299:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000dd17c1fd) 00000020:00000080:3.0:1788540872.621308:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788540872.621311:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788540872.621312:0:5873:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788540872.621314:0:5873:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788540872.621319:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788540872.621354:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dbee9412 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788540872.621373:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004ad47674) 00000020:00000080:3.0:1788540872.621381:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788540872.621472:0:5873:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788540872.621481:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1a79a 00000020:00000080:3.0:1788540872.621567:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788540872.621572:0:5873:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788540872.621576:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc9a6a13d3cd1a7a1 00080000:01000000:3.0:1788540872.621581:0:5873:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788540872.621584:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a7a8 00080000:10000000:3.0:1788540872.621948:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788540872.622141:0:5873:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788540872.626858:0:5873:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788540872.717706:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788540872.718234:0:5873:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788540872.721258:0:5873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788540872.721590:0:5873:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788540872.762230:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005572c317) 00000020:00000080:2.0:1788540872.762254:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788540872.762339:0:5873:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788540872.762347:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a7b6 00000020:00000080:3.0:1788540872.775260:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788540872.777646:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788540872.818618:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788540872.866357:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788540872.936342:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788540872.974664:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788540873.019551:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788540873.102866:0:5873:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc9a6a13d3cd1a7bd 00000020:00000080:3.0:1788540873.103244:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788540873.103256:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540873.103261:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540873.103264:0:5873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788540873.103266:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540873.103269:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540873.103270:0:5873:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788540873.103273:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788540873.103274:0:5873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788540873.103276:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540873.103278:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540873.103279:0:5873:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788540873.103281:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540873.103284:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540873.103285:0:5873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788540873.103307:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788540873.103341:0:5873:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788540873.103391:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5873:1875420968387840:0@lo:502: 00000100:00100000:3.0:1788540873.103504:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540873.103567:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ab7fa27 going to sleep for 11 seconds 00000100:00100000:0.0:1788540873.103739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387840 00000100:00100000:0.0:1788540873.103762:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387840 00000100:00100000:0.0:1788540873.103812:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540873.103820:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c03c2a54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5873:x1875420968387840:12345-0@lo:502: 00000100:00100000:0.0:1788540873.104054:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c03c2a54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5873:x1875420968387840:12345-0@lo:502: Request processed in 235us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.104062:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788540873.104270:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5873:1875420968387840:0@lo:502: 00000020:01000000:3.0:1788540873.104300:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540873.104305:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540873.104306:0:5873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788540873.104310:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788540873.105515:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788540873.105536:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788540873.105551:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.105560:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000fc1fe8ab/0xc9a6a13d3cd1a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540873.105566:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d782e54800 from 1 10000000:01000000:0.0:1788540873.105568:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540873.105619:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.105624:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.105631:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540873.105645:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000294457cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387968:0@lo:101: 00000100:00100000:0.0:1788540873.105687:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540873.105885:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000003a268c80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540873.109153:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968387968 00000100:00100000:3.0:1788540873.109166:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968387968 00000100:00100000:3.0:1788540873.109250:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788540873.109256:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9888c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:5831:x1875420968387968:12345-0@lo:101: 00010000:00010000:3.0:1788540873.109270:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540873.109285:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a7c4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.109314:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.109323:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.109329:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdc76ff6, rc 0) 00000100:00100000:3.0:1788540873.109394:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9888c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:5831:x1875420968387968:12345-0@lo:101: Request processed in 139us (3706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540873.109405:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788540873.109525:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000294457cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968387968:0@lo:101: 00010000:00010000:1.0:1788540873.109540:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.109547:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540873.110170:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388096:0@lo:256: 00000100:00100000:1.0:1788540873.110206:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.110614:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068322d9f going to sleep for 11 seconds 00000100:00100000:0.0:1788540873.110805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388096 00000100:00100000:0.0:1788540873.110817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388096 00000100:00100000:0.0:1788540873.110842:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540873.110847:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c6cfb0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:5831:x1875420968388096:12345-0@lo:256: 20000000:01000000:0.0:1788540873.110863:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788540873.110867:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788540873.110956:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c6cfb0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:5831:x1875420968388096:12345-0@lo:256: Request processed in 108us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.110962:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788540873.111112:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388096:0@lo:256: 10000000:01000000:1.0:1788540873.118167:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788540873.118188:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.118198:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540873.118203:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d782e54800 from 1 10000000:01000000:1.0:1788540873.118205:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788540873.118243:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.122102:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.122117:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540873.122154:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388224:0@lo:101: 00000100:00100000:1.0:1788540873.122230:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.122285:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068322d9f going to sleep for 11 seconds 00000100:00100000:0.0:1788540873.122391:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388224 00000100:00100000:0.0:1788540873.122405:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388224 00000100:00100000:0.0:1788540873.122456:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540873.122462:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fa4f8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:5831:x1875420968388224:12345-0@lo:101: 00010000:00010000:0.0:1788540873.122473:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540873.122486:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a7d2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.122503:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.122510:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.122516:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000220665d6, rc 0) 00000100:00100000:0.0:1788540873.122543:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fa4f8b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968388224:12345-0@lo:101: Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.122548:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540873.122672:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388224:0@lo:101: 00010000:00010000:1.0:1788540873.122683:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.122689:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540873.122735:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388352:0@lo:501: 00000100:00100000:1.0:1788540873.122768:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.122795:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068322d9f going to sleep for 11 seconds 00000100:00100000:0.0:1788540873.122913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388352 00000100:00100000:0.0:1788540873.122916:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388352 00000100:00100000:0.0:1788540873.122928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540873.122943:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000864a5c2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968388352:12345-0@lo:501: 00000100:00100000:0.0:1788540873.123278:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000864a5c2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968388352:12345-0@lo:501: Request processed in 333us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.123285:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540873.123517:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388352:0@lo:501: 00000100:00100000:1.0:1788540873.123541:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388480:0@lo:503: 00000100:00100000:1.0:1788540873.123569:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.123592:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068322d9f going to sleep for 11 seconds 00000100:00100000:0.0:1788540873.123629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388480 00000100:00100000:0.0:1788540873.123633:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388480 00000100:00100000:0.0:1788540873.123646:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540873.123650:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e1644d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968388480:12345-0@lo:503: 00000040:00080000:0.0:1788540873.123675:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540873.123706:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e1644d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968388480:12345-0@lo:503: Request processed in 56us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.123711:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540873.123781:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388480:0@lo:503: 00000040:00080000:1.0:1788540873.124678:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788540873.124934:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788540873.124953:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788540873.124970:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.124980:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540873.125027:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788540873.125030:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d782e54800 10000000:01000000:0.0:1788540873.125032:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d782e54800 10000000:01000000:0.0:1788540873.125036:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788540873.125041:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d782e54800 from 1 10000000:01000000:0.0:1788540873.125044:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788540873.125071:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.125087:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.125097:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540873.125115:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001febdd5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388608:0@lo:101: 00000100:00100000:0.0:1788540873.125163:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540873.125189:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d5dfa60a going to sleep for 11 seconds 00000100:00100000:1.0:1788540873.125308:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388608 00000100:00100000:1.0:1788540873.125313:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388608 00000100:00100000:1.0:1788540873.125350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540873.125357:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069eff936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968388608:12345-0@lo:101: 00010000:00010000:1.0:1788540873.125367:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540873.125376:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6153bc2/0xc9a6a13d3cd1a7e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a7e0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.125406:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6153bc2/0xc9a6a13d3cd1a7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.125434:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6153bc2/0xc9a6a13d3cd1a7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.125442:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6153bc2, rc 0) 00000100:00100000:1.0:1788540873.125474:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069eff936 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5831:x1875420968388608:12345-0@lo:101: Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540873.125480:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540873.125516:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001febdd5a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388608:0@lo:101: 00010000:00010000:1.0:1788540873.125528:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540873.125536:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540873.125576:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388736:0@lo:501: 00000100:00100000:1.0:1788540873.125595:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.125606:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a114099 going to sleep for 11 seconds 00000100:00100000:1.0:1788540873.125618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388736 00000100:00100000:1.0:1788540873.125626:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388736 00000100:00100000:1.0:1788540873.125639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540873.125643:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090696495 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5831:x1875420968388736:12345-0@lo:501: 00000100:00100000:1.0:1788540873.125853:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090696495 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5831:x1875420968388736:12345-0@lo:501: Request processed in 209us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540873.125860:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540873.125883:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388736:0@lo:501: 00000100:00100000:1.0:1788540873.125904:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388864:0@lo:503: 00000100:00100000:1.0:1788540873.126047:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.126059:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a114099 going to sleep for 11 seconds 00000100:00100000:1.0:1788540873.126071:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388864 00000100:00100000:1.0:1788540873.126074:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388864 00000100:00100000:1.0:1788540873.126087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788540873.126092:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cd7c148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5831:x1875420968388864:12345-0@lo:503: 00000100:00100000:1.0:1788540873.126215:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cd7c148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5831:x1875420968388864:12345-0@lo:503: Request processed in 122us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540873.126221:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788540873.126256:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968388864:0@lo:503: 00000100:00100000:1.0:1788540873.126654:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5878:1875420968388992:0@lo:502: 00000100:00100000:1.0:1788540873.126686:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.126703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968388992 00000100:00100000:1.0:1788540873.126706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968388992 00000100:00100000:1.0:1788540873.126725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540873.126729:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa803fa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5878:x1875420968388992:12345-0@lo:502: 00000100:00100000:1.0:1788540873.126872:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa803fa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5878:x1875420968388992:12345-0@lo:502: Request processed in 142us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540873.126886:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540873.127032:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb35edd4 going to sleep for 11 seconds 00000100:00100000:1.0:1788540873.127045:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5878:1875420968388992:0@lo:502: 00000020:01000004:1.0:1788540873.127095:0:5878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788540873.127110:0:5878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000038b292b0) 00000020:00000080:1.0:1788540873.127127:0:5878:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788540873.127203:0:5878:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dbee9412 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788540873.127206:0:5878:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000dbee9412 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788540873.127209:0:5878:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000dbee9412 4 00010000:00080000:1.0:1788540873.127243:0:5878:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b2ef6e69@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1788540873.134343:0:5878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788540873.134645:0:5878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788540873.134684:0:5878:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788540873.134699:0:5878:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc9a6a13d3cd1a7f5 00000100:00080000:1.0:1788540873.134709:0:5878:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540873.134714:0:5878:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2ef6e69 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1788540873.134759:0:5878:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c094c86b x1875420968389120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788540873.134802:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968389120:0@lo:38: 00000100:00100000:1.0:1788540873.134877:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.135235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389120 00000100:00100000:1.0:1788540873.135243:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389120 00000100:00100000:1.0:1788540873.135327:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540873.135333:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006518884d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875420968389120:12345-0@lo:38: 00000100:00100000:1.0:1788540873.135383:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006518884d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875420968389120:12345-0@lo:38: Request processed in 49us (506us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788540873.135390:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788540873.137030:0:5878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788540873.141057:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540873.141071:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000b2ef6e69 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788540873.141080:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788540873.141083:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968389120:0@lo:38: 00000100:00100000:1.0:1788540873.146528:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5878:1875420968389248:0@lo:502: 00000100:00100000:1.0:1788540873.146619:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540873.146669:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab734cab going to sleep for 11 seconds 00000100:00100000:2.0:1788540873.146770:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389248 00000100:00100000:2.0:1788540873.146778:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389248 00000100:00100000:2.0:1788540873.146830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788540873.146848:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000169dd8a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5878:x1875420968389248:12345-0@lo:502: 00000100:00100000:2.0:1788540873.147081:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000169dd8a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5878:x1875420968389248:12345-0@lo:502: Request processed in 235us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540873.147089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788540873.147296:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:5878:1875420968389248:0@lo:502: 00000040:00080000:1.0:1788540873.147321:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788540873.147707:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788540873.147725:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788540873.147749:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540873.147760:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 00000000bdca637c/0xc9a6a13d3cd1a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788540873.147802:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788540873.147804:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788540873.147806:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540873.147807:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540873.147808:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540873.147809:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540873.147810:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540873.147811:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788540873.147813:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540873.147814:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540873.147815:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540873.147816:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540873.147819:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788540873.147821:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788540873.147822:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788540873.147823:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540873.147824:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540873.147825:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540873.147825:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540873.147826:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540873.147827:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788540873.147828:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540873.147829:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540873.147833:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540873.147834:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540873.147856:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788540873.147866:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a7acccc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968389376:0@lo:253: 00000100:00100000:2.0:1788540873.147899:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540873.148018:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006da1464d going to sleep for 11 seconds 00000100:00100000:2.0:1788540873.148040:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389376 00000100:00100000:2.0:1788540873.148045:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389376 00000100:00100000:2.0:1788540873.148078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788540873.148083:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9d078a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5831:x1875420968389376:12345-0@lo:253: 20000000:01000000:2.0:1788540873.148109:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788540873.148120:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788540873.192220:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788540873.192253:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788540873.192594:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788540873.192600:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788540873.192624:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540873.192645:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540873.192654:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540873.192694:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540873.192711:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 12 pid: 5842 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540873.192725:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f83724ee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875420968389504:0@lo:104: 00000100:00100000:2.0:1788540873.192802:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540873.192872:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8b13191 going to sleep for 11 seconds 00000100:00100000:0.0:1788540873.196276:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389504 00000100:00100000:0.0:1788540873.196292:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389504 00000100:00100000:0.0:1788540873.196359:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540873.196369:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d0f06f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5866:x1875420968389504:12345-0@lo:104: 00010000:00010000:0.0:1788540873.196386:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540873.196715:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540873.196720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d0f06f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5866:x1875420968389504:12345-0@lo:104: Request processed in 354us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.196728:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788540873.196813:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788540873.196819:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.196827:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c81f112f already unused, calling callback (000000002ca8fcfa) 10000000:00010000:3.0:1788540873.196830:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.196838:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788540873.196844:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540873.196850:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788540873.196891:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.196898:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788540873.196920:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.196927:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: 00000000c81f112f/0xc9a6a13d3cd1a7c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.196946:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540873.196947:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540873.196949:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540873.196975:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f83724ee pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875420968389504:0@lo:104: 00010000:00010000:3.0:1788540873.196996:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540873.198686:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968389632:0@lo:103: 00000100:00100000:0.0:1788540873.198756:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540873.198891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389632 00000100:00100000:3.0:1788540873.198900:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389632 00010000:00010000:3.0:1788540873.198939:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 13 pid: 5842 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540873.198975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540873.198983:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007790346 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:3315:x1875420968389632:12345-0@lo:103: 00010000:00010000:3.0:1788540873.198996:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540873.199000:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 13 pid: 5842 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199011:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 13 pid: 5842 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199025:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdc76ff6/0xc9a6a13d3cd1a7cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7c4 expref: 13 pid: 5842 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199040:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199048:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788540873.199066:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006467228s 00010000:00010000:3.0:1788540873.199070:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199076:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199101:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199107:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199113:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075187f24 already unused, calling callback (000000005668ae46) 00010000:00010000:3.0:1788540873.199117:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199124:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199138:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199148:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540873.199184:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007790346 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3315:x1875420968389632:12345-0@lo:103: Request processed in 202us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540873.199192:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540873.199229:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968389632:0@lo:103: 00010000:00010000:3.0:1788540873.199258:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199265:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540873.199271:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a7fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540873.207979:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9d078a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5831:x1875420968389376:12345-0@lo:253: Request processed in 59888us (60071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540873.207998:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540873.208138:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a7acccc pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:5831:1875420968389376:0@lo:253: 10000000:01000000:3.0:1788540873.208154:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788540873.208157:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788540873.208159:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788540873.208160:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540873.208161:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540873.208162:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540873.208163:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540873.208165:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540873.208166:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788540873.208167:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540873.208169:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540873.208170:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540873.208171:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788540873.208185:0:5831:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788540873.215347:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788540873.215606:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788540873.215801:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788540873.215925:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788540873.216057:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788540873.216160:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788540873.217794:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788540873.217961:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788540873.218172:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788540873.218555:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788540873.218769:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788540873.218938:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788540873.266170:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:0.0:1788540873.304472:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788540873.304789:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788540873.304860:0:5883:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788540873.304863:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788540873.305173:0:5884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788540873.308767:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788540873.309052:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788540873.311860:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788540873.311880:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788540873.312138:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788540873.314540:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788540873.315207:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788540873.315241:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788540873.315853:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788540873.316040:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788540873.320841:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788540873.321157:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788540873.321305:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788540873.321564:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788540873.321710:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788540873.321851:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788540873.325100:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788540873.325303:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788540873.325474:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788540873.325608:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788540873.325782:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788540873.325917:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788540873.326076:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788540873.326230:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788540873.326380:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788540873.326543:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788540873.326852:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788540873.326984:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788540873.327150:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788540873.327299:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788540873.327473:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788540873.327604:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788540873.330502:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788540873.331009:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788540873.331334:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788540873.331839:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788540873.332826:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788540873.332990:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788540873.333144:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788540873.333290:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788540873.333693:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788540873.333852:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788540873.334200:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788540873.358858:0:5884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788540873.415631:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788540873.415668:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb64401bc7988 00100000:10000000:3.0:1788540873.415677:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:2.0:1788540873.418100:0:5884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000020:01000004:3.0:1788540873.418257:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788540873.418274:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788540873.418292:0:5831:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788540873.418312:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000004:00080000:2.0:1788540873.419672:0:5884:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788540873.419681:0:5884:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788540874.331552:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540875.352206:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540876.375821:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540877.402828:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788540877.428342:0:6127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788540878.295598:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788540878.295608:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788540878.295611:0:8:0:(import.c:65:import_set_state_nolock()) 00000000b2ef6e69 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788540878.295623:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2ef6e69 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1788540878.295646:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000064f3c11 x1875420968389888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788540878.295686:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000064f3c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968389888:0@lo:38: 00000100:00100000:3.0:1788540878.295765:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540878.295872:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389888 00000100:00100000:3.0:1788540878.295880:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389888 00000100:00100000:3.0:1788540878.295914:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540878.295927:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4bdd0e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875420968389888:12345-0@lo:38: 00010000:00080000:3.0:1788540878.295949:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:3.0:1788540878.295984:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc9a6a13d3cd1a803 00000004:00100000:3.0:1788540878.296033:0:5852:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788540878.296144:0:5852:0:(import.c:65:import_set_state_nolock()) 00000000fa0e0e5c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540878.296191:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4bdd0e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875420968389888:12345-0@lo:38: Request processed in 264us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540878.296198:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788540878.296254:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000064f3c11 x1875420968389888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788540878.296267:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788540878.296273:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788540878.296277:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788540878.296279:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000b2ef6e69 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788540878.296283:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000064f3c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968389888:0@lo:38: 00000100:00100000:2.0:1788540878.296657:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788540878.296666:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968389760:0@lo:400: 00000100:00100000:2.0:1788540878.296709:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540878.296745:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968389760 00000100:00100000:2.0:1788540878.296748:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968389760 00000100:00100000:2.0:1788540878.296777:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788540878.296783:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e91e71b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:3317:x1875420968389760:12345-0@lo:400: 00000100:00100000:2.0:1788540878.296818:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e91e71b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:3317:x1875420968389760:12345-0@lo:400: Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540878.296825:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788540878.296868:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b72d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968389760:0@lo:400: 00010000:00010000:0.0:1788540878.435111:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540879.447875:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540880.471514:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788540881.367532:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788540881.367544:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d782e54800 from 3 10000000:01000000:0.0:1788540881.367552:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540881.367616:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540881.367633:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540881.367648:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540881.367693:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001049074b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390016:0@lo:101: 00000100:00100000:0.0:1788540881.367812:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540881.367890:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc8c9486 going to sleep for 11 seconds 00000100:00100000:1.0:1788540881.368092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390016 00000100:00100000:1.0:1788540881.368102:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390016 00000100:00100000:1.0:1788540881.368171:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788540881.368182:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061c657bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5848:x1875420968390016:12345-0@lo:101: 00010000:00010000:1.0:1788540881.368199:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540881.368217:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021b265d3/0xc9a6a13d3cd1a811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a80a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540881.368248:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021b265d3/0xc9a6a13d3cd1a811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540881.368260:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021b265d3/0xc9a6a13d3cd1a811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540881.368271:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021b265d3, rc 0) 00000100:00100000:1.0:1788540881.368329:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061c657bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968390016:12345-0@lo:101: Request processed in 150us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540881.368337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788540881.369483:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001049074b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390016:0@lo:101: 00010000:00010000:0.0:1788540881.369511:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540881.369523:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540881.369614:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001049074b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390144:0@lo:256: 00000100:00100000:0.0:1788540881.369684:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540881.369724:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc8c9486 going to sleep for 11 seconds 00000100:00100000:1.0:1788540881.369821:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390144 00000100:00100000:1.0:1788540881.369828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390144 00000100:00100000:1.0:1788540881.369886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788540881.369895:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e108b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968390144:12345-0@lo:256: 20000000:01000000:1.0:1788540881.369915:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788540881.369943:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788540881.369947:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788540881.370037:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e108b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968390144:12345-0@lo:256: Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540881.370045:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788540881.370345:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001049074b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390144:0@lo:256: 10000000:01000000:2.0:1788540881.370394:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788540881.370401:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540881.370451:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: 0000000013f99314/0xc9a6a13d3cd1a80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540881.506554:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540882.519768:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788540882.722089:0:6329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd8739990 20000000:00000080:3.0:1788540882.722115:0:6329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d7ad85d000 uarg=0000000000000000 20000000:01000000:3.0:1788540882.722166:0:6329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788540882.722177:0:6329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788540882.722184:0:6329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788540882.722642:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788540882.722670:0:6329:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788540882.729088:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788540882.729387:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788540882.729772:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788540882.729905:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788540882.729927:0:6329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788540882.729952:0:6329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540882.729977:0:6329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540882.729987:0:6329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540882.730037:0:6329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540882.730057:0:6329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 11 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540882.730074:0:6329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000037ff6ae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875420968390272:0@lo:104: 00000100:00100000:2.0:1788540882.730161:0:6329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540882.730275:0:6329:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9d3e92e going to sleep for 11 seconds 00000100:00100000:0.0:1788540882.730350:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390272 00000100:00100000:0.0:1788540882.730361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390272 00000100:00100000:0.0:1788540882.730666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540882.730678:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000872def72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:6329:x1875420968390272:12345-0@lo:104: 00010000:00010000:0.0:1788540882.730696:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540882.730829:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540882.730836:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000872def72 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:6329:x1875420968390272:12345-0@lo:104: Request processed in 161us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540882.730843:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788540882.730913:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540882.730922:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.730930:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000529d150 already unused, calling callback (000000002ca8fcfa) 10000000:00010000:1.0:1788540882.730933:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.730943:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540882.730951:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540882.730958:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788540882.731002:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731009:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540882.731031:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: 000000000529d150/0xc9a6a13d3cd1a7d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7d9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731090:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540882.731093:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540882.731094:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540882.731119:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968390400:0@lo:103: 00000100:00100000:1.0:1788540882.731162:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540882.731218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390400 00000100:00100000:1.0:1788540882.731224:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390400 00010000:00010000:1.0:1788540882.731250:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 12 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540882.731277:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540882.731284:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000708a3d3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3317:x1875420968390400:12345-0@lo:103: 00010000:00010000:1.0:1788540882.731298:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540882.731303:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 12 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731313:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 12 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731337:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731347:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731365:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731380:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731386:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731392:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731397:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075187f24 already unused, calling callback (000000005668ae46) 00010000:00010000:1.0:1788540882.731401:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731442:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731452:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540882.731463:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540882.731711:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000708a3d3d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3317:x1875420968390400:12345-0@lo:103: Request processed in 428us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540882.731720:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788540882.731842:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c094c86b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968390400:0@lo:103: 00010000:00010000:3.0:1788540882.732060:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000220665d6/0xc9a6a13d3cd1a7d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7d2 expref: 11 pid: 5844 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540882.732074:0:6329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000037ff6ae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875420968390272:0@lo:104: 00010000:00010000:3.0:1788540882.732097:0:6329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540882.732107:0:6329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540882.732113:0:6329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540882.732119:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000075187f24/0xc9a6a13d3cd1a818 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540883.415727:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000064f3c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968390528:0@lo:400: 00000100:00100000:0.0:1788540883.415848:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540883.415925:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540883.415931:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027d0a694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968390656:0@lo:400: 00000100:00100000:0.0:1788540883.415966:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540883.416130:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390528 00000100:00100000:3.0:1788540883.416141:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390528 00000100:00100000:3.0:1788540883.416199:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788540883.416208:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006129d11d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:3314:x1875420968390528:12345-0@lo:400: 00000100:00100000:3.0:1788540883.416267:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006129d11d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:3314:x1875420968390528:12345-0@lo:400: Request processed in 61us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540883.416274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788540883.416327:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000064f3c11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968390528:0@lo:400: 00000100:00100000:1.0:1788540883.416445:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390656 00000100:00100000:1.0:1788540883.416450:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390656 00000100:00100000:1.0:1788540883.416481:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540883.416487:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a17779d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968390656:12345-0@lo:400: 00000100:00100000:1.0:1788540883.416525:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a17779d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968390656:12345-0@lo:400: Request processed in 39us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540883.416545:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788540883.418929:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000027d0a694 x1875420968390656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540883.418955:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027d0a694 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968390656:0@lo:400: 00010000:00010000:0.0:1788540883.545660:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540884.567999:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540885.591708:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540886.615966:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788540887.519008:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788540887.519020:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d782e54800 from 1 10000000:01000000:2.0:1788540887.519034:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540887.519096:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: 00000000cdfe8afc/0xc9a6a13d3cd1a81f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540887.519111:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: 00000000cdfe8afc/0xc9a6a13d3cd1a81f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540887.519124:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: 00000000cdfe8afc/0xc9a6a13d3cd1a81f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540887.519155:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bf9c236 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390784:0@lo:101: 00000100:00100000:2.0:1788540887.519250:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540887.519314:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000639eb45d going to sleep for 11 seconds 00000100:00100000:0.0:1788540887.519388:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390784 00000100:00100000:0.0:1788540887.519400:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390784 00000100:00100000:0.0:1788540887.519496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540887.519508:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f5a498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:5848:x1875420968390784:12345-0@lo:101: 00010000:00010000:0.0:1788540887.519537:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540887.519554:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c9c91b77/0xc9a6a13d3cd1a826 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a81f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540887.519592:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9c91b77/0xc9a6a13d3cd1a826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540887.519607:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c9c91b77/0xc9a6a13d3cd1a826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540887.519629:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c9c91b77, rc 0) 00000100:00100000:0.0:1788540887.519680:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f5a498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968390784:12345-0@lo:101: Request processed in 174us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540887.519688:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540887.519765:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bf9c236 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390784:0@lo:101: 00010000:00010000:0.0:1788540887.519783:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: 00000000cdfe8afc/0xc9a6a13d3cd1a81f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540887.519794:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: 00000000cdfe8afc/0xc9a6a13d3cd1a81f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540887.519874:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f805869 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390912:0@lo:501: 00000100:00100000:0.0:1788540887.519902:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540887.519923:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abf38f74 going to sleep for 11 seconds 00000100:00100000:0.0:1788540887.519936:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968390912 00000100:00100000:0.0:1788540887.519941:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968390912 00000100:00100000:0.0:1788540887.519965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540887.519970:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009facf390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968390912:12345-0@lo:501: 00000100:00100000:0.0:1788540887.520303:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009facf390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968390912:12345-0@lo:501: Request processed in 331us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540887.520311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540887.520346:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f805869 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968390912:0@lo:501: 00000100:00100000:0.0:1788540887.520378:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f805869 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968391040:0@lo:503: 00000100:00100000:0.0:1788540887.520530:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540887.520561:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abf38f74 going to sleep for 11 seconds 00000100:00100000:2.0:1788540887.520804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391040 00000100:00100000:2.0:1788540887.520810:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391040 00000100:00100000:2.0:1788540887.520847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788540887.520855:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000534cf2b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968391040:12345-0@lo:503: 00000100:00100000:2.0:1788540887.521158:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000534cf2b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968391040:12345-0@lo:503: Request processed in 303us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540887.521165:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788540887.521282:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f805869 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968391040:0@lo:503: 00000100:00100000:0.0:1788540887.522623:0:6602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f805869 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6602:1875420968391168:0@lo:502: 00000100:00100000:0.0:1788540887.522700:0:6602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540887.522746:0:6602:0:(client.c:2716:ptlrpc_set_wait()) set 00000000296d971d going to sleep for 11 seconds 00000100:00100000:2.0:1788540887.522799:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391168 00000100:00100000:2.0:1788540887.522807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391168 00000100:00100000:2.0:1788540887.522887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788540887.522897:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007963d35a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6602:x1875420968391168:12345-0@lo:502: 00000100:00100000:2.0:1788540887.523153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007963d35a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6602:x1875420968391168:12345-0@lo:502: Request processed in 257us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540887.523161:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788540887.524893:0:6602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f805869 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6602:1875420968391168:0@lo:502: 00000020:01000000:3.0:1788540887.524961:0:6602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540887.524975:0:6602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540887.524979:0:6602:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788540887.524987:0:6602:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d782e54800 00000020:00000080:3.0:1788540887.525010:0:6602:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788540887.525084:0:6602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6602:1875420968391296:0@lo:502: 00000100:00100000:3.0:1788540887.525171:0:6602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540887.527732:0:6602:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540887.527782:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391296 00000100:00100000:0.0:1788540887.527796:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391296 00000100:00100000:0.0:1788540887.527867:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788540887.527880:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6602:x1875420968391296:12345-0@lo:502: 00000100:00100000:0.0:1788540887.528241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6602:x1875420968391296:12345-0@lo:502: Request processed in 363us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540887.528250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540887.529774:0:6602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6602:1875420968391296:0@lo:502: 00000020:01000000:1.0:1788540887.529840:0:6602:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540887.529854:0:6602:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540887.529857:0:6602:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788540887.529864:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788540887.534280:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788540887.534339:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788540887.534355:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540887.534371:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540887.643259:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540888.536970:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968391424:0@lo:400: 00000100:00100000:3.0:1788540888.537010:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968391552:0@lo:400: 00000100:00100000:2.0:1788540888.537080:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540888.537114:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540888.537172:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391552 00000100:00100000:3.0:1788540888.537180:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391552 00000100:00100000:3.0:1788540888.537231:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540888.537241:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968391552:12345-0@lo:400: 00000100:00100000:3.0:1788540888.537293:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968391552:12345-0@lo:400: Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540888.537301:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788540888.537341:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d7bc719f80 x1875420968391552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540888.537354:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968391552:0@lo:400: 00000100:00100000:0.0:1788540888.537622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391424 00000100:00100000:0.0:1788540888.537627:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391424 00000100:00100000:0.0:1788540888.537667:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788540888.537674:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3316:x1875420968391424:12345-0@lo:400: 00000100:00100000:0.0:1788540888.537718:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3316:x1875420968391424:12345-0@lo:400: Request processed in 45us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540888.537725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788540888.537746:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968391424:0@lo:400: 00010000:00010000:2.0:1788540888.668778:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540889.687735:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788540889.697334:0:6702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788540889.697338:0:6702:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788540889.697517:0:6702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d7831d9800 00000020:01000004:3.0:1788540889.697533:0:6702:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788540889.697543:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788540889.697556:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98d7ae254d40) 00000020:00000080:3.0:1788540889.697571:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788540889.716740:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788540889.717105:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788540889.747665:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788540889.756983:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788540889.757020:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788540889.757156:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788540889.757189:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788540889.758933:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788540889.758950:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788540889.758966:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9a6a13d3cd1a834 00000020:01000004:0.0:1788540889.758975:0:6702:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788540889.758997:0:6702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788540889.759001:0:6702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788540889.759007:0:6702:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788540889.759011:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788540889.759039:0:6702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98d78994cd40) 00000020:00000080:0.0:1788540889.759053:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788540889.760741:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540889.761052:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788540889.761058:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788540889.761970:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788540889.761977:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788540889.762367:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788540889.762374:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788540889.765549:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540889.770180:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788540889.770197:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788540889.776391:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788540889.776431:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788540889.832355:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788540889.832755:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788540889.832763:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788540889.837876:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788540889.837890:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788540889.839985:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788540889.840004:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788540889.848961:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540889.849161:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788540889.849175:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788540889.851168:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788540889.851188:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788540889.894501:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788540889.894724:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788540889.894731:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788540889.898785:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788540889.898804:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788540889.899707:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788540889.899737:0:6702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788540889.899745:0:6702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788540889.933098:0:6702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788540889.933142:0:6702:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788540889.933146:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788540889.933148:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788540889.933149:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540889.933150:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540889.933151:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540889.933152:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540889.933154:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540889.933155:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540889.933156:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540889.933158:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540889.933160:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788540889.933163:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788540889.933165:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788540889.933167:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788540889.933168:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540889.933169:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540889.933170:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540889.933171:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540889.933172:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540889.933173:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540889.933174:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540889.933175:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540889.933176:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788540889.933204:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788540889.933222:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968391680:0@lo:253: 00000100:00100000:0.0:1788540889.933288:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540889.933457:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782f0a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540889.935184:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391680 00000100:00100000:2.0:1788540889.935196:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391680 00000100:00100000:2.0:1788540889.935261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788540889.935272:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968391680:12345-0@lo:253: 20000000:01000000:2.0:1788540889.935305:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788540889.935310:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788540889.935315:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788540889.935318:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788540889.939260:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788540889.940288:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788540889.940311:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788540889.940376:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788540889.940385:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788540889.940448:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788540889.940499:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788540889.942017:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788540889.942050:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:2.0:1788540889.942052:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:2.0:1788540889.942090:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788540889.942100:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788540889.942148:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788540889.942157:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:2.0:1788540889.942210:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788540889.942220:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788540889.942249:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788540889.942309:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788540889.944274:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788540889.944302:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:3.0:1788540889.944304:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:3.0:1788540889.944338:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788540889.944345:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788540889.944675:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788540889.944685:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:3.0:1788540889.944735:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788540889.944745:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788540889.944774:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788540889.944807:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788540889.944935:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788540889.944939:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788540889.944942:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788540889.944954:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788540889.944957:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788540889.944989:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788540889.944992:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788540889.947009:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788540889.947097:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788540889.947164:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788540889.947975:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788540889.948021:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788540889.948054:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788540889.948067:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788540889.948069:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788540889.951682:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788540889.951770:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788540889.951844:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788540889.952170:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788540889.952213:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788540889.952295:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788540889.952309:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788540889.952312:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788540889.952851:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788540889.953054:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788540889.953097:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788540889.953174:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788540889.953193:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788540889.953195:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788540889.953205:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788540889.953225:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953245:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953253:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953261:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953268:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953308:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953322:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 12 pid: 5844 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540889.953335:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968391808:0@lo:104: 00000100:00100000:0.0:1788540889.953399:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540889.953508:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953527:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 12 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540889.953537:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968391936:0@lo:104: 00000100:00100000:0.0:1788540889.953561:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540889.953586:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.953604:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 12 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540889.953613:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968392064:0@lo:104: 00000100:00100000:0.0:1788540889.953633:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540889.953643:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782f0ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540889.953658:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391808 00000100:00100000:2.0:1788540889.953666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391808 00000100:00100000:2.0:1788540889.953699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968391936 00000100:00100000:2.0:1788540889.953702:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968391936 00000100:00100000:2.0:1788540889.953710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392064 00000100:00100000:2.0:1788540889.953712:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392064 00000100:00100000:2.0:1788540889.953724:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788540889.953732:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5842:x1875420968391808:12345-0@lo:104: 00010000:00010000:2.0:1788540889.953746:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.953959:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540889.953967:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5842:x1875420968391808:12345-0@lo:104: Request processed in 235us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540889.953974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788540889.953987:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788540889.953991:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788540889.953994:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540889.953997:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:5842:x1875420968391936:12345-0@lo:104: 00010000:00010000:1.0:1788540889.954002:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc1bc0c20) 00010000:00010000:2.0:1788540889.954005:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540889.954006:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954015:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540889.954023:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540889.954038:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540889.954041:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540889.954046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:5842:x1875420968391936:12345-0@lo:104: Request processed in 50us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540889.954051:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540889.954063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788540889.954067:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540889.954068:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5842:x1875420968392064:12345-0@lo:104: 00010000:00010000:1.0:1788540889.954074:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540889.954085:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954090:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954097:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1a7e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a7e7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954112:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540889.954115:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954120:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540889.954123:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954129:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540889.954135:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540889.954140:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540889.954153:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954159:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540889.954170:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954176:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1a770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a777 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954186:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540889.954188:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540889.954190:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788540889.954190:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540889.954193:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540889.954195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5842:x1875420968392064:12345-0@lo:104: Request processed in 127us (561us total) trans 0 rc 0/0 00010000:00010000:1.0:1788540889.954200:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bce00 already unused, calling callback (ffffffffc1bc0c20) 00000100:00100000:2.0:1788540889.954201:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:00010000:1.0:1788540889.954203:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954209:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540889.954216:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540889.954221:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540889.954233:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540889.954237:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968392192:0@lo:103: 00010000:00010000:1.0:1788540889.954240:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540889.954254:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954261:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1a754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a75b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540889.954262:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540889.954280:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788540889.954280:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540889.954281:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540889.954283:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540889.954285:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968392320:0@lo:103: 00000100:00100000:1.0:1788540889.954292:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788540889.954300:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968392448:0@lo:103: 00000100:00100000:2.0:1788540889.954303:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540889.954322:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540889.954340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392192 00000100:00100000:2.0:1788540889.954344:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392192 00000100:00100000:1.0:1788540889.954344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392320 00000100:00100000:1.0:1788540889.954347:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392320 00010000:00010000:2.0:1788540889.954361:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 14 pid: 5844 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540889.954361:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 14 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540889.954375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392448 00000100:00100000:1.0:1788540889.954377:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392448 00000100:00100000:2.0:1788540889.954379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788540889.954384:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3314:x1875420968392192:12345-0@lo:103: 00010000:00010000:1.0:1788540889.954385:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 15 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.954393:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788540889.954395:0:5837:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788540889.954397:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 15 pid: 5844 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540889.954401:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788540889.954428:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 15 pid: 5844 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.954444:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540889.954479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3314:x1875420968392192:12345-0@lo:103: Request processed in 95us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540889.954485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788540889.954505:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540889.954511:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:3314:x1875420968392320:12345-0@lo:103: 00010000:00010000:2.0:1788540889.954519:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540889.954523:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 14 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.954532:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 14 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540889.954534:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540889.954542:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540889.954597:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968392192:0@lo:103: 00010000:00010000:0.0:1788540889.954673:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781678600/0xc9a6a13d3cd1a7e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a7e0 expref: 14 pid: 5844 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540889.954682:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968391808:0@lo:104: 00010000:00010000:0.0:1788540889.954692:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a770 expref: 13 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540889.954700:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968391936:0@lo:104: 00000100:00100000:0.0:1788540889.954707:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968392064:0@lo:104: 00010000:00010000:0.0:1788540889.954725:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540889.954926:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3314:x1875420968392320:12345-0@lo:103: Request processed in 414us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540889.954933:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540889.954947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540889.954953:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:3317:x1875420968392448:12345-0@lo:103: 00010000:00010000:2.0:1788540889.954962:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540889.954966:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 11 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.954974:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 11 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.954984:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a75b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a754 expref: 11 pid: 5843 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.954996:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955003:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955024:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955031:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955037:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955043:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955048:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788540889.955052:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.955060:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540889.955081:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968392320:0@lo:103: 00010000:00010000:0.0:1788540889.958711:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.958712:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540889.958729:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540889.958736:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788540889.958736:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1a842 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788540889.958754:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788540889.959257:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:3317:x1875420968392448:12345-0@lo:103: Request processed in 4298us (4927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540889.959266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788540889.959296:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968392448:0@lo:103: 00000100:00100000:1.0:1788540890.064873:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:6702:x1875420968391680:12345-0@lo:253: Request processed in 129593us (131573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.064889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788540890.064977:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968391680:0@lo:253: 10000000:01000000:0.0:1788540890.064994:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788540890.064997:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788540890.064999:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788540890.065001:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540890.065002:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788540890.065004:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540890.065005:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540890.065007:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540890.065008:0:6702:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788540890.065010:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540890.065012:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788540890.065036:0:6702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d7831d9800 from lustre-OST0000 10000000:01000000:0.0:1788540890.065065:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788540890.065069:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788540890.065210:0:6702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d7b2f70000 local copy 10000000:01000000:0.0:1788540890.065216:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788540890.065261:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.065271:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.065280:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540890.065320:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392576:0@lo:101: 00000100:00100000:0.0:1788540890.065535:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540890.065664:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392576 00000100:00100000:2.0:1788540890.065672:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392576 00000100:00100000:2.0:1788540890.065832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788540890.065843:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+9:6702:x1875420968392576:12345-0@lo:101: 00010000:00010000:2.0:1788540890.065864:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540890.065881:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a849 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.065909:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a849 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.065920:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a849 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.065929:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fdc00, rc 0) 00000100:00100000:2.0:1788540890.065961:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:6702:x1875420968392576:12345-0@lo:101: Request processed in 121us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540890.065967:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788540890.066288:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782f0a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540890.066308:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392576:0@lo:101: 00010000:00010000:2.0:1788540890.066327:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.066336:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540890.066482:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392704:0@lo:501: 00000100:00100000:2.0:1788540890.066513:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540890.066706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392704 00000100:00100000:1.0:1788540890.066711:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392704 00000100:00100000:1.0:1788540890.066748:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788540890.066763:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:6702:x1875420968392704:12345-0@lo:501: 00000100:00100000:1.0:1788540890.066973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:6702:x1875420968392704:12345-0@lo:501: Request processed in 217us (458us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788540890.066980:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788540890.067326:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540890.067344:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392704:0@lo:501: 10000000:01000000:2.0:1788540890.067494:0:6702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788540890.067529:0:6702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788540890.067542:0:6702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.067552:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.067558:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.067630:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788540890.067652:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d7831d9800 10000000:01000000:2.0:1788540890.067657:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788540890.067663:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98d7b2f70000 10000000:01000000:2.0:1788540890.067665:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788540890.067668:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98d7b2f70000 from 1 10000000:01000000:2.0:1788540890.067671:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788540890.067695:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.067704:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540890.067712:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540890.067729:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392832:0@lo:101: 00000100:00100000:2.0:1788540890.067771:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540890.067796:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788540890.067915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392832 00000100:00100000:0.0:1788540890.067921:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392832 00000100:00100000:0.0:1788540890.067961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788540890.067967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+10:6702:x1875420968392832:12345-0@lo:101: 00010000:00010000:0.0:1788540890.067976:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540890.067988:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780030c00/0xc9a6a13d3cd1a85e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a857 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.068010:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030c00/0xc9a6a13d3cd1a85e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a857 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.068019:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780030c00/0xc9a6a13d3cd1a85e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a857 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.068027:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030c00, rc 0) 00000100:00100000:0.0:1788540890.068081:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:6702:x1875420968392832:12345-0@lo:101: Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540890.068087:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788540890.068300:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392832:0@lo:101: 00010000:00010000:3.0:1788540890.068313:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.068322:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540890.068338:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788540890.068364:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.068372:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540890.068378:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788540890.068382:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788540890.068386:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788540890.068389:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540890.068424:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.068432:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.068452:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.068466:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392960:0@lo:101: 00000100:00100000:3.0:1788540890.068495:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.068515:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b2fe43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540890.068702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968392960 00000100:00100000:0.0:1788540890.068708:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968392960 00000100:00100000:0.0:1788540890.068735:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540890.068741:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:6702:x1875420968392960:12345-0@lo:101: 00010000:00010000:0.0:1788540890.068749:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540890.068771:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a865 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.068801:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.068809:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.068816:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031c00, rc 0) 00000100:00100000:0.0:1788540890.068855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968392960:12345-0@lo:101: Request processed in 113us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540890.068861:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788540890.069007:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968392960:0@lo:101: 00010000:00010000:3.0:1788540890.069018:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.069026:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.069222:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393088:0@lo:501: 00000100:00100000:3.0:1788540890.069248:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.069269:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b2fe43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540890.069331:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393088 00000100:00100000:2.0:1788540890.069336:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393088 00000100:00100000:2.0:1788540890.069357:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788540890.069372:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393088:12345-0@lo:501: 00000100:00100000:2.0:1788540890.069611:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393088:12345-0@lo:501: Request processed in 240us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540890.069618:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788540890.069694:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393088:0@lo:501: 00000100:00100000:3.0:1788540890.069733:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393216:0@lo:503: 00000100:00100000:3.0:1788540890.069783:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.069806:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b2fe43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540890.069932:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393216 00000100:00100000:2.0:1788540890.069938:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393216 00000100:00100000:2.0:1788540890.069955:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788540890.069960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393216:12345-0@lo:503: 00000100:00100000:2.0:1788540890.070257:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393216:12345-0@lo:503: Request processed in 295us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540890.070263:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788540890.070298:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393216:0@lo:503: 00000040:00080000:2.0:1788540890.070598:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540890.070660:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393344:0@lo:502: 00000100:00100000:2.0:1788540890.070697:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540890.070714:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540890.070738:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393344 00000100:00100000:2.0:1788540890.070742:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393344 00000100:00100000:2.0:1788540890.070953:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788540890.070962:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393344:12345-0@lo:502: 00000100:00100000:2.0:1788540890.071216:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393344:12345-0@lo:502: Request processed in 255us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540890.071222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788540890.071261:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393344:0@lo:502: 00000040:00080000:2.0:1788540890.072014:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788540890.072087:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788540890.072347:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788540890.072399:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00010000:00010000:1.0:1788540890.072546:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540890.072556:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.072566:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540890.072570:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.072581:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540890.072599:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540890.072605:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540890.072636:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.072643:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540890.072663:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.072670:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1a849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9a6a13d3cd1a850 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.072685:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540890.072687:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540890.072695:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540890.072747:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968393472:0@lo:103: 00000100:00100000:1.0:1788540890.072807:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540890.073080:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393472 00000100:00100000:1.0:1788540890.073087:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393472 00000040:00080000:2.0:1788540890.073242:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788540890.073282:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788540890.073309:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393600:0@lo:502: 00000100:00100000:2.0:1788540890.073352:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540890.073662:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540890.073671:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3317:x1875420968393472:12345-0@lo:103: 00010000:00010000:1.0:1788540890.073685:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540890.073702:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a849 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.073719:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540890.073762:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:3317:x1875420968393472:12345-0@lo:103: Request processed in 91us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.073769:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540890.073819:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968393472:0@lo:103: 00000100:00100000:2.0:1788540890.075625:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540890.075721:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393600 00000100:00100000:0.0:1788540890.075733:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393600 00000100:00100000:2.0:1788540890.076026:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788540890.076036:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:6702:x1875420968393600:12345-0@lo:502: 00000100:00100000:2.0:1788540890.076709:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:6702:x1875420968393600:12345-0@lo:502: Request processed in 672us (3354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540890.076720:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540890.076972:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393600:0@lo:502: 00000040:00080000:3.0:1788540890.077266:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788540890.077285:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788540890.077993:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788540890.078002:0:6723:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788540890.078008:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540890.078010:0:6723:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788540890.078016:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788540890.078032:0:6723:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98d7899499c0) 00000020:00000080:0.0:1788540890.078057:0:6723:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788540890.078064:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788540890.078657:0:6723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d7831d9800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788540890.078667:0:6723:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788540890.078677:0:6723:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9a6a13d3cd1a87a 00010000:00010000:2.0:1788540890.086403:0:6723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788540890.086885:0:6723:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788540890.089873:0:6723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788540890.090533:0:6723:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788540890.099875:0:6723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788540890.100871:0:6723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788540890.102599:0:6723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788540890.102614:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540890.102621:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540890.102624:0:6723:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788540890.102627:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540890.102631:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540890.102632:0:6723:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788540890.102636:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788540890.102637:0:6723:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788540890.102691:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540890.102694:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540890.102695:0:6723:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788540890.102698:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788540890.102908:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788540890.102936:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788540890.102958:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.102971:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540890.102980:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7831d9800 from 1 10000000:01000000:3.0:1788540890.102982:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788540890.103022:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.103031:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.103042:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.103070:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393728:0@lo:101: 00000100:00100000:3.0:1788540890.107272:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.107339:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b2fe4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.107623:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393728 00000100:00100000:1.0:1788540890.107647:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393728 00000100:00100000:1.0:1788540890.107690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788540890.107699:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:6702:x1875420968393728:12345-0@lo:101: 00010000:00010000:1.0:1788540890.107714:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540890.107732:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a881 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.107887:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.107900:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.107909:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781678400, rc 0) 00000100:00100000:1.0:1788540890.107961:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393728:12345-0@lo:101: Request processed in 262us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.107968:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788540890.108046:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393728:0@lo:101: 00010000:00010000:3.0:1788540890.108065:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.108216:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.108348:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393856:0@lo:501: 00000100:00100000:3.0:1788540890.108394:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.108455:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b2fe4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.108635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393856 00000100:00100000:1.0:1788540890.108641:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393856 00000100:00100000:1.0:1788540890.108680:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788540890.108688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393856:12345-0@lo:501: 00000100:00100000:1.0:1788540890.108948:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393856:12345-0@lo:501: Request processed in 259us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.108955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788540890.111499:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393856:0@lo:501: 00000100:00100000:3.0:1788540890.111557:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393984:0@lo:503: 00000100:00100000:3.0:1788540890.111646:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.111687:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b2fe4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.112213:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968393984 00000100:00100000:1.0:1788540890.112221:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968393984 00000100:00100000:1.0:1788540890.112274:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788540890.112284:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393984:12345-0@lo:503: 00000100:00100000:1.0:1788540890.112552:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968393984:12345-0@lo:503: Request processed in 268us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.112566:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788540890.112631:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968393984:0@lo:503: 00000040:00080000:1.0:1788540890.113007:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788540890.113309:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394112:0@lo:502: 00000100:00100000:1.0:1788540890.113698:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540890.113744:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.113915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394112 00000100:00100000:1.0:1788540890.113922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394112 00000100:00100000:1.0:1788540890.113978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788540890.113987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968394112:12345-0@lo:502: 00000100:00100000:1.0:1788540890.115623:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968394112:12345-0@lo:502: Request processed in 1633us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.115636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788540890.116517:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394112:0@lo:502: 00000040:00080000:2.0:1788540890.117333:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788540890.117926:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788540890.117973:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394240:0@lo:502: 00000100:00100000:2.0:1788540890.118044:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540890.118307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394240 00000100:00100000:0.0:1788540890.118315:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394240 00000100:00100000:0.0:1788540890.118514:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788540890.118524:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968394240:12345-0@lo:502: 00000100:00100000:2.0:1788540890.119856:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788540890.121783:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968394240:12345-0@lo:502: Request processed in 3253us (3732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540890.121805:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788540890.125020:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394240:0@lo:502: 00000040:00080000:3.0:1788540890.125750:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788540890.125854:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788540890.126713:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540890.126724:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540890.126726:0:6727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788540890.126733:0:6727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d7831d9800 00000020:00000080:1.0:1788540890.126735:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788540890.126835:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540890.126839:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540890.126841:0:6727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788540890.126844:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788540890.126991:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788540890.127012:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788540890.127066:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.127087:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540890.127250:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788540890.127253:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d7831d9800 10000000:01000000:3.0:1788540890.127256:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d7831d9800 10000000:01000000:3.0:1788540890.127260:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788540890.127265:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d7831d9800 from 1 10000000:01000000:3.0:1788540890.127268:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540890.127303:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.127312:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.127323:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.127368:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394368:0@lo:101: 00000100:00100000:3.0:1788540890.127495:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.127545:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782d99f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.127625:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394368 00000100:00100000:1.0:1788540890.127634:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394368 00000100:00100000:1.0:1788540890.127677:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788540890.127686:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968394368:12345-0@lo:101: 00010000:00010000:1.0:1788540890.127700:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540890.127713:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a88f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.127744:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.127768:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.127777:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781679a00, rc 0) 00000100:00100000:1.0:1788540890.127825:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394368:12345-0@lo:101: Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.127831:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788540890.128013:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394368:0@lo:101: 00010000:00010000:3.0:1788540890.128029:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.128039:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.128263:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394496:0@lo:501: 00000100:00100000:3.0:1788540890.128293:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.128369:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782d99f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540890.128905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394496 00000100:00100000:2.0:1788540890.128911:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394496 00000100:00100000:3.0:1788540890.129056:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788540890.129066:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394496:12345-0@lo:501: 00000100:00100000:3.0:1788540890.129378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394496:12345-0@lo:501: Request processed in 311us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540890.129386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788540890.129528:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394496:0@lo:501: 00000100:00100000:0.0:1788540890.129569:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394624:0@lo:503: 00000100:00100000:0.0:1788540890.129621:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540890.130057:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782f0ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.130243:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394624 00000100:00100000:1.0:1788540890.130251:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394624 00000100:00100000:1.0:1788540890.130283:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788540890.130291:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394624:12345-0@lo:503: 00000100:00100000:1.0:1788540890.130491:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394624:12345-0@lo:503: Request processed in 198us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.130498:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788540890.130607:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394624:0@lo:503: 00000040:00080000:0.0:1788540890.130917:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540890.130980:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394752:0@lo:502: 00000100:00100000:0.0:1788540890.131016:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540890.131047:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782f0ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540890.131290:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394752 00000100:00100000:1.0:1788540890.131295:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394752 00000100:00100000:1.0:1788540890.131319:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788540890.131326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394752:12345-0@lo:502: 00000100:00100000:1.0:1788540890.131523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394752:12345-0@lo:502: Request processed in 196us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540890.131531:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788540890.131622:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394752:0@lo:502: 00000040:00080000:0.0:1788540890.131928:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788540890.131977:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788540890.132006:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788540890.132069:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788540890.132241:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788540890.132284:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788540890.132318:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788540890.132347:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788540890.132386:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788540890.132725:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788540890.132777:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788540890.132825:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788540890.132858:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788540890.132894:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788540890.132943:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788540890.132979:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788540890.133028:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788540890.133177:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788540890.133212:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788540890.133255:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788540890.133298:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788540890.133330:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788540890.133364:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788540890.133439:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788540890.133476:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788540890.133505:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788540890.133562:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788540890.133614:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788540890.133664:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394880:0@lo:502: 00000100:00100000:0.0:1788540890.133737:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540890.133780:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782f0ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788540890.133950:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968394880 00000100:00100000:3.0:1788540890.133958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968394880 00000100:00100000:3.0:1788540890.134008:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788540890.134017:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394880:12345-0@lo:502: 00000100:00100000:3.0:1788540890.134240:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968394880:12345-0@lo:502: Request processed in 223us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540890.134247:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788540890.134448:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968394880:0@lo:502: 00000040:00080000:0.0:1788540890.134522:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788540890.134533:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788540890.135455:0:6728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788540890.135471:0:6728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98d789948000) 00000020:00000080:0.0:1788540890.135490:0:6728:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788540890.135574:0:6728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d7831d9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788540890.135578:0:6728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d7831d9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788540890.135581:0:6728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7831d9800 3 00010000:00080000:0.0:1788540890.135617:0:6728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7bf6d8800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1788540890.138567:0:6728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788540890.138852:0:6728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788540890.138886:0:6728:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788540890.138899:0:6728:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc9a6a13d3cd1a8a4 00000100:00080000:0.0:1788540890.138910:0:6728:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788540890.138921:0:6728:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98d7bf6d8800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788540890.138955:0:6728:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bc719500 x1875420968395008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788540890.138979:0:6728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788540890.139334:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1788540890.139643:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875420968395008:0@lo:38: 00000100:00100000:3.0:1788540890.139720:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788540890.139799:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788540890.139829:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788540890.139844:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.139856:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788540890.139910:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788540890.139912:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788540890.139914:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540890.139915:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540890.139916:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540890.139918:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540890.139919:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788540890.139921:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540890.139922:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540890.139923:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540890.139925:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788540890.139929:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788540890.139931:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788540890.139932:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788540890.139933:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540890.139934:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540890.139935:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540890.139936:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540890.139937:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788540890.139938:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540890.139939:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540890.139940:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540890.139941:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788540890.139960:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788540890.139973:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968395136:0@lo:253: 00000100:00100000:3.0:1788540890.140007:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540890.140044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395136 00000100:00100000:3.0:1788540890.140051:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395136 00000100:00100000:3.0:1788540890.140851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788540890.140867:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6702:x1875420968395136:12345-0@lo:253: 20000000:01000000:3.0:1788540890.140901:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788540890.140918:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788540890.141528:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d784f28180 going to sleep for 11 seconds 00000100:00100000:0.0:1788540890.141943:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395008 00000100:00100000:0.0:1788540890.141951:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395008 00000100:00100000:0.0:1788540890.141981:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788540890.141988:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875420968395008:12345-0@lo:38: 00010000:00080000:0.0:1788540890.142010:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1788540890.142042:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc9a6a13d3cd1a8ab 00000004:00100000:0.0:1788540890.142056:0:5852:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788540890.142206:0:5852:0:(import.c:65:import_set_state_nolock()) ffff98d7bf6da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540890.142286:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875420968395008:12345-0@lo:38: Request processed in 297us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540890.142294:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788540890.142384:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d7bc719500 x1875420968395008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540890.142430:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788540890.142438:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788540890.142446:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788540890.142450:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788540890.142452:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7bf6d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788540890.142458:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875420968395008:0@lo:38: 00000100:00100000:0.0:1788540890.142539:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968395264:0@lo:400: 00000100:00100000:0.0:1788540890.142573:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540890.152729:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395264 00000100:00100000:2.0:1788540890.152743:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395264 00000100:00100000:2.0:1788540890.152800:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788540890.152811:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968395264:12345-0@lo:400: 00000100:00100000:2.0:1788540890.152900:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968395264:12345-0@lo:400: Request processed in 90us (10325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540890.152908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788540890.152996:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d7aeca3100 x1875420968395264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540890.153012:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968395264:0@lo:400: 20000000:01000000:3.0:1788540890.185449:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788540890.185472:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788540890.185577:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788540890.185583:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788540890.185619:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.185656:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.185665:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.185708:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540890.185723:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 13 pid: 5843 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540890.185739:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875420968395392:0@lo:104: 00000100:00100000:1.0:1788540890.185822:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540890.185918:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831ca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540890.186652:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395392 00000100:00100000:0.0:1788540890.186661:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395392 00000100:00100000:0.0:1788540890.186713:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540890.186723:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5866:x1875420968395392:12345-0@lo:104: 00010000:00010000:0.0:1788540890.186737:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.186821:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540890.186828:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5866:x1875420968395392:12345-0@lo:104: Request processed in 107us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540890.186836:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788540890.186857:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540890.186864:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.186871:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540890.186875:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.186885:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540890.186892:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540890.186898:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540890.186928:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.186935:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540890.186951:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.186958:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031200/0xc9a6a13d3cd1a80a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.186988:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540890.186990:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540890.186992:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540890.187015:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968395520:0@lo:103: 00000100:00100000:0.0:1788540890.187055:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540890.187131:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395520 00000100:00100000:0.0:1788540890.187136:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395520 00010000:00010000:0.0:1788540890.187153:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 14 pid: 5843 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540890.187176:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540890.187183:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78316c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:3315:x1875420968395520:12345-0@lo:103: 00010000:00010000:0.0:1788540890.187192:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540890.187198:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 14 pid: 5843 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187208:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 14 pid: 5843 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187227:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187235:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788540890.187250:0:6720:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006467228s 00010000:00010000:0.0:1788540890.187254:0:6720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187272:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187280:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187287:0:6720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187292:0:6720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788540890.187296:0:6720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187303:0:6720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187312:0:6720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540890.187321:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540890.187363:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78316c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:3315:x1875420968395520:12345-0@lo:103: Request processed in 181us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540890.187370:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540890.187455:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968395520:0@lo:103: 00010000:00010000:3.0:1788540890.187780:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1a811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a80a expref: 13 pid: 5843 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.187792:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875420968395392:0@lo:104: 00010000:00010000:3.0:1788540890.187806:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.187816:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.187822:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540890.187829:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781678200/0xc9a6a13d3cd1a8b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540890.205796:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:6702:x1875420968395136:12345-0@lo:253: Request processed in 64923us (65776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540890.205812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788540890.205961:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:6702:1875420968395136:0@lo:253: 10000000:01000000:0.0:1788540890.205978:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788540890.205982:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788540890.205984:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788540890.205985:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540890.205999:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540890.206000:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540890.206002:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540890.206003:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540890.206005:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540890.206007:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540890.206009:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540890.206010:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788540890.206029:0:6702:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788540890.215860:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788540890.216029:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788540890.216218:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788540890.216384:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788540890.216650:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788540890.216868:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788540890.218920:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788540890.448161:0:6702:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788540890.448176:0:6702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788540890.448205:0:6702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788540890.448258:0:6702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788540890.448277:0:6702:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788540890.448305:0:6702:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788540890.713708:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540891.738452:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540892.760594:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788540892.887507:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788540892.887518:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d782e54800 from 21 10000000:01000000:0.0:1788540892.887525:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788540892.887599:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540892.887612:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540892.887638:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540892.887670:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968395648:0@lo:101: 00000100:00100000:0.0:1788540892.887762:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540892.887851:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d784fc3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540892.888017:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395648 00000100:00100000:1.0:1788540892.888027:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395648 00000100:00100000:1.0:1788540892.888095:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788540892.888106:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968395648:12345-0@lo:101: 00010000:00010000:1.0:1788540892.888123:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540892.888146:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a8b9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540892.888173:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540892.888185:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540892.888195:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781679e00, rc 0) 00000100:00100000:1.0:1788540892.888246:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968395648:12345-0@lo:101: Request processed in 142us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540892.888253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788540892.888578:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968395648:0@lo:101: 00010000:00010000:3.0:1788540892.888596:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540892.888606:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540892.888685:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968395776:0@lo:501: 00000100:00100000:3.0:1788540892.888717:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.888762:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540892.888909:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395776 00000100:00100000:1.0:1788540892.888914:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395776 00000100:00100000:1.0:1788540892.888938:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788540892.888945:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968395776:12345-0@lo:501: 00000100:00100000:1.0:1788540892.889291:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968395776:12345-0@lo:501: Request processed in 345us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540892.889299:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788540892.889458:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968395776:0@lo:501: 00000100:00100000:3.0:1788540892.889494:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968395904:0@lo:503: 00000100:00100000:3.0:1788540892.889535:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.889558:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540892.889737:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968395904 00000100:00100000:0.0:1788540892.889743:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968395904 00000100:00100000:0.0:1788540892.889774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788540892.889794:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968395904:12345-0@lo:503: 00000100:00100000:0.0:1788540892.890120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968395904:12345-0@lo:503: Request processed in 337us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540892.890128:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788540892.890957:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968395904:0@lo:503: 00000100:00100000:3.0:1788540892.898333:0:6848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6848:1875420968396032:0@lo:502: 00000100:00100000:3.0:1788540892.898943:0:6848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.899042:0:6848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540892.900142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396032 00000100:00100000:0.0:1788540892.900170:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396032 00000100:00100000:0.0:1788540892.900251:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788540892.900263:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6848:x1875420968396032:12345-0@lo:502: 00000100:00100000:0.0:1788540892.900667:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6848:x1875420968396032:12345-0@lo:502: Request processed in 406us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540892.900675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788540892.901154:0:6848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6848:1875420968396032:0@lo:502: 00000100:00100000:3.0:1788540892.901251:0:6848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6848:1875420968396160:0@lo:502: 00000100:00100000:3.0:1788540892.901303:0:6848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.901358:0:6848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540892.901486:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396160 00000100:00100000:2.0:1788540892.901492:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396160 00000100:00100000:2.0:1788540892.901525:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788540892.901534:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6848:x1875420968396160:12345-0@lo:502: 00000100:00100000:2.0:1788540892.901716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:6848:x1875420968396160:12345-0@lo:502: Request processed in 183us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540892.901724:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788540892.902053:0:6848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6848:1875420968396160:0@lo:502: 00000040:00080000:3.0:1788540892.902075:0:6848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788540892.902235:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788540892.902265:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788540892.902275:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540892.902286:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540892.902295:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788540892.902305:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d782e54800 from 4 10000000:01000000:1.0:1788540892.902308:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788540892.902334:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540892.902342:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540892.902352:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540892.902366:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396288:0@lo:101: 00000100:00100000:1.0:1788540892.902396:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540892.902463:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d783fedcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540892.902664:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396288 00000100:00100000:2.0:1788540892.902669:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396288 00000100:00100000:2.0:1788540892.902701:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788540892.902709:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968396288:12345-0@lo:101: 00010000:00010000:2.0:1788540892.902720:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540892.903094:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a8c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540892.903119:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540892.903130:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540892.903139:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fdc00, rc 0) 00000100:00100000:2.0:1788540892.903184:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968396288:12345-0@lo:101: Request processed in 475us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540892.903190:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788540892.903284:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396288:0@lo:101: 00010000:00010000:3.0:1788540892.903298:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540892.903308:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540892.903359:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396416:0@lo:256: 00000100:00100000:3.0:1788540892.903389:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.903443:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540892.903493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396416 00000100:00100000:0.0:1788540892.903498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396416 00000100:00100000:0.0:1788540892.903527:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788540892.903535:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968396416:12345-0@lo:256: 20000000:01000000:0.0:1788540892.903552:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788540892.903580:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788540892.903583:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788540892.903665:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968396416:12345-0@lo:256: Request processed in 130us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540892.903672:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788540892.904053:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396416:0@lo:256: 10000000:01000000:3.0:1788540892.904107:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788540892.904115:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540892.904125:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540892.904133:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788540892.904135:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788540892.904137:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540892.904160:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540892.904168:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540892.904182:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540892.904196:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396544:0@lo:101: 00000100:00100000:3.0:1788540892.904226:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.904263:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540892.904345:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396544 00000100:00100000:0.0:1788540892.904351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396544 00000100:00100000:0.0:1788540892.904382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788540892.904388:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968396544:12345-0@lo:101: 00010000:00010000:0.0:1788540892.904395:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540892.904404:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a8d5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540892.904446:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540892.904455:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540892.904474:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030400, rc 0) 00000100:00100000:0.0:1788540892.904504:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968396544:12345-0@lo:101: Request processed in 116us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540892.904509:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788540892.904591:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396544:0@lo:101: 00010000:00010000:3.0:1788540892.904601:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540892.904611:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540892.904660:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396672:0@lo:501: 00000100:00100000:3.0:1788540892.904685:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.904709:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540892.904951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396672 00000100:00100000:1.0:1788540892.904957:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396672 00000100:00100000:1.0:1788540892.904996:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788540892.905004:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968396672:12345-0@lo:501: 00000100:00100000:1.0:1788540892.905489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968396672:12345-0@lo:501: Request processed in 484us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540892.905496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788540892.906083:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396672:0@lo:501: 00000100:00100000:3.0:1788540892.906124:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396800:0@lo:503: 00000100:00100000:3.0:1788540892.906171:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.906207:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540892.906336:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396800 00000100:00100000:0.0:1788540892.906343:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396800 00000100:00100000:0.0:1788540892.906382:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788540892.906390:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968396800:12345-0@lo:503: 00000100:00100000:0.0:1788540892.908940:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968396800:12345-0@lo:503: Request processed in 2541us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540892.908954:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788540892.909289:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968396800:0@lo:503: 00000100:00100000:3.0:1788540892.909998:0:6849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6849:1875420968396928:0@lo:502: 00000100:00100000:3.0:1788540892.910059:0:6849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540892.910099:0:6849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540892.910258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968396928 00000100:00100000:2.0:1788540892.910265:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968396928 00000100:00100000:2.0:1788540892.910304:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788540892.910314:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:6849:x1875420968396928:12345-0@lo:502: 00000100:00100000:2.0:1788540892.910961:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:6849:x1875420968396928:12345-0@lo:502: Request processed in 646us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540892.910971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788540892.911154:0:6849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6849:1875420968396928:0@lo:502: 00000020:01000000:3.0:1788540892.911198:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788540892.911208:0:6849:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788540892.911216:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540892.911218:0:6849:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788540892.911223:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788540892.911227:0:6849:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:3.0:1788540892.911269:0:6849:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788540892.911273:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788540892.911293:0:6849:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98d7ae2519c0) 00000020:00000080:3.0:1788540892.911319:0:6849:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788540892.911325:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788540892.911464:0:6849:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788540892.911471:0:6849:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788540892.911479:0:6849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a8ea 00010000:00080000:3.0:1788540892.911509:0:6849:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7831fa800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1788540892.912300:0:6849:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788540892.992943:0:6849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788540892.992979:0:6849:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788540892.994106:0:6849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788540892.994376:0:6849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788540892.994468:0:6849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788540892.994688:0:6849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788540892.998040:0:6853:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788540892.998048:0:6853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788540892.999322:0:6849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788540892.999338:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788540892.999376:0:6849:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788540892.999400:0:6849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1a8f1 00000100:00080000:3.0:1788540892.999493:0:6849:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788540892.999500:0:6849:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d7831fa800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1788540892.999758:0:6849:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7aeca1f80 x1875420968397056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788540892.999873:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968397056:0@lo:8: 00000100:00100000:3.0:1788540892.999945:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788540893.000013:0:6849:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788540893.000076:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540893.000081:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540893.000082:0:6849:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788540893.000086:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540893.000090:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540893.000091:0:6849:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788540893.000094:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788540893.000102:0:6849:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788540893.000127:0:6849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6849:1875420968397184:0@lo:502: 00000100:00100000:2.0:1788540893.000168:0:6849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540893.000186:0:6849:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540893.000265:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968397312:0@lo:400: 00000100:00100000:2.0:1788540893.000299:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540893.000318:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540893.000324:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968397440:0@lo:400: 00000100:00100000:2.0:1788540893.000344:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540893.000376:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397312 00000100:00100000:2.0:1788540893.000382:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397312 00000100:00100000:2.0:1788540893.000438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397440 00000100:00100000:2.0:1788540893.000442:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397440 00000100:00100000:2.0:1788540893.000470:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540893.000478:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968397312:12345-0@lo:400: 00000100:00100000:2.0:1788540893.000543:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968397312:12345-0@lo:400: Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540893.000550:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540893.000577:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540893.000588:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968397440:12345-0@lo:400: 00000100:00100000:2.0:1788540893.000616:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968397440:12345-0@lo:400: Request processed in 34us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540893.000622:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788540893.000651:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788540893.000675:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca1180 x1875420968397440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540893.000689:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968397440:0@lo:400: 00010000:00080000:2.0:1788540893.000712:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca1c00 x1875420968397312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540893.000720:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968397312:0@lo:400: 00000100:00100000:2.0:1788540893.000747:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397184 00000100:00100000:2.0:1788540893.000750:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397184 00000100:00100000:2.0:1788540893.000773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788540893.000780:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:6849:x1875420968397184:12345-0@lo:502: 00000100:00100000:2.0:1788540893.001164:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:6849:x1875420968397184:12345-0@lo:502: Request processed in 382us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540893.001171:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788540893.004080:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397056 00000100:00100000:3.0:1788540893.004092:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397056 00000100:00100000:3.0:1788540893.004141:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540893.004150:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875420968397056:12345-0@lo:8: 00010000:00080000:3.0:1788540893.004178:0:6704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1788540893.004213:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1a8f8 00002000:00100000:3.0:1788540893.004277:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98d7831fe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788540893.004282:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788540893.004287:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788540893.004478:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788540893.004643:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788540893.004673:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98d7831fb800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788540893.004854:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca1f80 x1875420968397056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788540902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540893.004868:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540893.004877:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788540893.004886:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788540893.004893:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788540893.004896:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7831fa800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788540893.004907:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788540893.004920:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968397056:0@lo:8: 00000100:00100000:3.0:1788540893.005311:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875420968397056:12345-0@lo:8: Request processed in 1159us (5363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540893.005321:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:3.0:1788540893.005472:0:6853:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788540893.005619:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 178005209392ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788540893.006329:0:6849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:6849:1875420968397184:0@lo:502: 00000020:01000000:2.0:1788540893.006375:0:6849:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540893.006383:0:6849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540893.006385:0:6849:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788540893.006389:0:6849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788540893.006698:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788540893.006720:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788540893.006731:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540893.006743:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540893.006753:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788540893.006756:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d7b2f70000 from 1 10000000:01000000:1.0:1788540893.006758:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788540893.006790:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540893.006798:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540893.006807:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540893.006824:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968397568:0@lo:101: 00000100:00100000:1.0:1788540893.006882:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540893.006924:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788540893.006994:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397568 00000100:00100000:2.0:1788540893.007002:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397568 00000100:00100000:2.0:1788540893.007043:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788540893.007052:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968397568:12345-0@lo:101: 00010000:00010000:2.0:1788540893.007064:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540893.007078:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a8ff expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540893.007106:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540893.007116:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540893.007134:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fc600, rc 0) 00000100:00100000:2.0:1788540893.007184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968397568:12345-0@lo:101: Request processed in 133us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540893.007190:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788540893.010142:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968397568:0@lo:101: 00010000:00010000:1.0:1788540893.010181:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540893.010196:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540893.010311:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968397696:0@lo:501: 00000100:00100000:1.0:1788540893.010386:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540893.010470:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788540893.010515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397696 00000100:00100000:3.0:1788540893.010524:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397696 00000100:00100000:3.0:1788540893.010598:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788540893.010612:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968397696:12345-0@lo:501: 00000100:00100000:3.0:1788540893.011032:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968397696:12345-0@lo:501: Request processed in 422us (644us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788540893.011042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788540893.012610:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968397696:0@lo:501: 10000000:01000000:1.0:1788540893.012676:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788540893.012688:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540893.012700:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788540893.111402:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788540893.218557:0:6854:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788540893.218613:0:6854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968397952:0@lo:7: 00000100:00100000:3.0:1788540893.218703:0:6854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540893.218765:0:6854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d784f28840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540893.218806:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968397824:0@lo:13: 00000100:00100000:3.0:1788540893.218833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540893.218873:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397952 00000100:00100000:3.0:1788540893.218881:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397952 00000100:00100000:3.0:1788540893.218939:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540893.218950:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6854:x1875420968397952:12345-0@lo:7: 00000100:00100000:0.0:1788540893.227507:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968397824 00000100:00100000:0.0:1788540893.227526:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968397824 00000100:00100000:0.0:1788540893.227614:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540893.227821:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968397824:12345-0@lo:13: 00000100:00080000:2.0:1788540893.227832:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788540893.227876:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788540893.227999:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968397824:12345-0@lo:13: Request processed in 374us (9164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540893.228007:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788540893.228232:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7ad256680 x1875420968397824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540893.228263:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968397824:0@lo:13: 00002000:00080000:3.0:1788540893.235708:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788540893.235717:0:6706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788540893.239765:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6854:x1875420968397952:12345-0@lo:7: Request processed in 20804us (21048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540893.239782:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788540893.239833:0:6854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7ad254380 x1875420968397952/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788540909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540893.239852:0:6854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968397952:0@lo:7: 00000004:00080000:2.0:1788540893.239868:0:6854:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788540893.239909:0:6854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968398080:0@lo:5: 00000100:00100000:2.0:1788540893.239948:0:6854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540893.240003:0:6854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540893.240100:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398080 00000100:00100000:3.0:1788540893.240107:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398080 00000100:00100000:3.0:1788540893.240156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540893.240165:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6854:x1875420968398080:12345-0@lo:5: 00002000:00080000:3.0:1788540893.240193:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788540893.240197:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788540893.240569:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6854:x1875420968398080:12345-0@lo:5: Request processed in 396us (611us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788540893.240577:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788540893.241936:0:6854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca2a00 x1875420968398080/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540893.241956:0:6854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968398080:0@lo:5: 00000004:00080000:2.0:1788540893.241970:0:6854:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788540893.242014:0:6854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968398208:0@lo:700: 00000100:00100000:2.0:1788540893.242059:0:6854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540893.242095:0:6854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540893.242259:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398208 00000100:00100000:1.0:1788540893.242267:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398208 00000100:00100000:1.0:1788540893.242315:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540893.242324:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6854:x1875420968398208:12345-0@lo:700: 00000100:00100000:1.0:1788540893.242359:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1875420968398336:0@lo:700: 00000100:00100000:1.0:1788540893.242398:0:6713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540893.242446:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfdf0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788540893.242994:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398336 00000100:00100000:0.0:1788540893.243000:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398336 00000100:00100000:0.0:1788540893.243081:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540893.243091:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1875420968398336:12345-0@lo:700: 40000000:02000000:0.0:1788540893.337672:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788540893.361071:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1875420968398336:12345-0@lo:700: Request processed in 117973us (118663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540893.361093:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788540893.361156:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d78904dc00 x1875420968398336/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788540909 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540893.361171:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1875420968398336:0@lo:700: 40000000:02000000:0.0:1788540893.361185:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788540893.445747:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788540893.445761:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788540893.448171:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6854:x1875420968398208:12345-0@lo:700: Request processed in 205838us (206102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540893.448194:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788540893.449764:0:6854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca1180 x1875420968398208/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788540909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540893.449779:0:6854:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788540893.449798:0:6854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968398208:0@lo:700: 00000004:02000040:3.0:1788540893.561520:0:6854:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788540893.569537:0:6854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968398464:0@lo:5: 00000100:00100000:3.0:1788540893.570896:0:6854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540893.570981:0:6854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bf496d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540893.571081:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398464 00000100:00100000:1.0:1788540893.571090:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398464 00000100:00100000:1.0:1788540893.571153:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540893.571164:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6854:x1875420968398464:12345-0@lo:5: 00002000:00080000:0.0:1788540893.586968:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788540893.587000:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788540893.620098:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6854:x1875420968398464:12345-0@lo:5: Request processed in 48924us (49196us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788540893.620125:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788540893.620323:0:6854:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7ad256a00 x1875420968398464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540893.620344:0:6854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6854:1875420968398464:0@lo:5: 00000004:00080000:2.0:1788540893.620362:0:6854:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788540893.783587:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540894.812229:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540895.831635:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540896.860599:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788540897.624040:0:7075:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788540897.883897:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540898.264632:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540898.264780:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968398720:0@lo:400: 00000100:00100000:2.0:1788540898.264858:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540898.264915:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540898.264922:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968398848:0@lo:400: 00000100:00100000:2.0:1788540898.264953:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540898.264991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398720 00000100:00100000:2.0:1788540898.264999:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398720 00000100:00100000:2.0:1788540898.265046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788540898.265055:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3316:x1875420968398720:12345-0@lo:400: 00000100:00100000:2.0:1788540898.265107:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3316:x1875420968398720:12345-0@lo:400: Request processed in 52us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540898.265114:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788540898.265146:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398848 00000100:00100000:2.0:1788540898.265150:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398848 00000100:00100000:2.0:1788540898.265174:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540898.265179:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968398848:12345-0@lo:400: 00000100:00100000:2.0:1788540898.265208:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968398848:12345-0@lo:400: Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540898.265214:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788540898.265250:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d78904f800 x1875420968398848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540898.265283:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968398848:0@lo:400: 00000100:00100000:2.0:1788540898.265295:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968398720:0@lo:400: 00000100:00100000:3.0:1788540898.265466:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788540898.265478:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968398976:0@lo:400: 00000100:00100000:3.0:1788540898.265510:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540898.267664:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398976 00000100:00100000:2.0:1788540898.267681:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398976 00000100:00080000:3.0:1788540898.267750:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540898.267780:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788540898.267791:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968398976:12345-0@lo:400: 00000100:00100000:2.0:1788540898.267900:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968398976:12345-0@lo:400: Request processed in 111us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540898.267908:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788540898.267988:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d78904d500 x1875420968398976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540898.268005:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968398976:0@lo:400: 00000100:00100000:0.0:1788540898.268100:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968398592:0@lo:13: 00000100:00100000:0.0:1788540898.268149:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540898.268890:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968398592 00000100:00100000:3.0:1788540898.268898:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968398592 00000100:00100000:3.0:1788540898.270875:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540898.270887:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968398592:12345-0@lo:13: 00002000:00000024:3.0:1788540898.270928:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540898.271011:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968398592:12345-0@lo:13: Request processed in 126us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540898.271018:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788540898.271089:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788540898.271368:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca1180 x1875420968398592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540898.271390:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968398592:0@lo:13: 00000001:00080000:0.0:1788540898.920301:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788540898.921886:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540899.929020:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540900.955378:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540901.983156:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540903.002630:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540903.385898:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968399104:0@lo:13: 00000100:00100000:0.0:1788540903.385973:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540903.386271:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399104 00000100:00100000:3.0:1788540903.386280:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399104 00000100:00100000:3.0:1788540903.386336:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540903.386347:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968399104:12345-0@lo:13: 00002000:00000024:3.0:1788540903.386389:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540903.386462:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968399104:12345-0@lo:13: Request processed in 106us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540903.386477:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788540903.387626:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788540903.388606:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968399232:0@lo:400: 00000100:00100000:2.0:1788540903.388686:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540903.388736:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540903.388743:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968399360:0@lo:400: 00000100:00100000:2.0:1788540903.388772:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540903.388807:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399360 00000100:00100000:2.0:1788540903.388814:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399360 00000100:00100000:2.0:1788540903.388857:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788540903.388866:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968399360:12345-0@lo:400: 00000100:00100000:2.0:1788540903.388915:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968399360:12345-0@lo:400: Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540903.388922:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788540903.388978:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7ad254380 x1875420968399360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540903.388994:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968399360:0@lo:400: 00000100:00100000:3.0:1788540903.389124:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399232 00000100:00100000:3.0:1788540903.389129:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399232 00000100:00100000:3.0:1788540903.389167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788540903.389175:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3316:x1875420968399232:12345-0@lo:400: 00000100:00100000:3.0:1788540903.389216:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3316:x1875420968399232:12345-0@lo:400: Request processed in 42us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540903.389222:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788540903.389435:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968399232:0@lo:400: 00010000:00080000:0.0:1788540903.391253:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca1f80 x1875420968399104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540903.391267:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788540903.391292:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968399104:0@lo:13: 00000100:00100000:0.0:1788540903.391306:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540903.391324:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968399488:0@lo:400: 00000100:00100000:0.0:1788540903.391376:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540903.391538:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399488 00000100:00100000:0.0:1788540903.391546:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399488 00000100:00100000:0.0:1788540903.391599:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540903.391610:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968399488:12345-0@lo:400: 00000100:00100000:0.0:1788540903.391728:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968399488:12345-0@lo:400: Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540903.391735:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788540903.391779:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7ad256680 x1875420968399488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540903.391789:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968399488:0@lo:400: 00000100:00080000:0.0:1788540903.391803:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788540904.023772:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540905.047877:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540906.071815:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540907.100556:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540908.119968:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540908.505832:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968399744:0@lo:400: 00000100:00100000:2.0:1788540908.505908:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540908.505970:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540908.505975:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968399872:0@lo:400: 00000100:00100000:2.0:1788540908.505997:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540908.506038:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399744 00000100:00100000:2.0:1788540908.506045:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399744 00000100:00100000:2.0:1788540908.506089:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399872 00000100:00100000:2.0:1788540908.506092:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399872 00000100:00100000:2.0:1788540908.506116:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788540908.506124:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968399744:12345-0@lo:400: 00000100:00100000:2.0:1788540908.506172:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968399744:12345-0@lo:400: Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.506179:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788540908.506196:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788540908.506202:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968399872:12345-0@lo:400: 00000100:00100000:2.0:1788540908.506226:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968399872:12345-0@lo:400: Request processed in 25us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.506232:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788540908.506280:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca0380 x1875420968399872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540908.506294:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968399872:0@lo:400: 00010000:00080000:2.0:1788540908.506304:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca3100 x1875420968399744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540908.506312:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968399744:0@lo:400: 00000100:00100000:0.0:1788540908.516050:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968399616:0@lo:400: 00000100:00100000:0.0:1788540908.516144:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.516204:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540908.516212:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968400000:0@lo:400: 00000100:00100000:0.0:1788540908.516243:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788540908.516292:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540908.516310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968399616 00000100:00100000:0.0:1788540908.516319:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968399616 00000100:00100000:0.0:1788540908.516364:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788540908.516373:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3315:x1875420968399616:12345-0@lo:400: 00000100:00100000:0.0:1788540908.516470:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3315:x1875420968399616:12345-0@lo:400: Request processed in 97us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.516477:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788540908.516531:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968399616:0@lo:400: 00000100:00100000:3.0:1788540908.516909:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400000 00000100:00100000:3.0:1788540908.516915:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400000 00000100:00100000:3.0:1788540908.516960:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540908.516969:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968400000:12345-0@lo:400: 00000100:00100000:3.0:1788540908.517014:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968400000:12345-0@lo:400: Request processed in 46us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540908.517020:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540908.517946:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540908.517968:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968400128:0@lo:13: 00000100:00100000:3.0:1788540908.518016:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788540908.521251:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788540908.521315:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca2680 x1875420968400000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540908.521334:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968400000:0@lo:400: 00000100:00100000:2.0:1788540908.522002:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400128 00000100:00100000:2.0:1788540908.522015:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400128 00000100:00100000:2.0:1788540908.522076:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540908.522088:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968400128:12345-0@lo:13: 00002000:00000024:2.0:1788540908.522131:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540908.522209:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968400128:12345-0@lo:13: Request processed in 123us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.522217:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788540908.522349:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7aeca3100 x1875420968400128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540908.522368:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968400128:0@lo:13: 00000020:01000004:0.0:1788540908.714137:0:7644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788540908.714142:0:7644:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788540908.714280:0:7644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d7bf6df000 00000020:01000004:0.0:1788540908.714296:0:7644:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788540908.714309:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788540908.714323:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98d78994b380) 00000020:00000080:0.0:1788540908.714340:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788540908.728678:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788540908.728968:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788540908.767121:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788540908.774891:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788540908.774925:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788540908.774980:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788540908.775003:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788540908.776845:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788540908.776859:0:7644:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788540908.776871:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9a6a13d3cd1a914 00000020:01000004:3.0:1788540908.776880:0:7644:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788540908.776900:0:7644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788540908.776903:0:7644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788540908.776908:0:7644:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788540908.776930:0:7644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788540908.776934:0:7644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788540908.825273:0:7644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788540908.825342:0:7644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.159@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788540908.825346:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788540908.825348:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540908.825350:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540908.825351:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788540908.825352:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540908.825353:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540908.825355:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540908.825357:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788540908.825358:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788540908.825360:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540908.825362:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788540908.825366:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788540908.825368:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788540908.825369:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540908.825371:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540908.825372:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788540908.825373:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540908.825374:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540908.825375:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540908.825376:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788540908.825377:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788540908.825378:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540908.825379:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788540908.825443:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788540908.825465:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968400256:0@lo:253: 00000100:00100000:1.0:1788540908.825560:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540908.828031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400256 00000100:00100000:2.0:1788540908.828051:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400256 00000100:00100000:2.0:1788540908.828124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788540908.828138:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:7644:x1875420968400256:12345-0@lo:253: 20000000:01000000:2.0:1788540908.828180:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788540908.828185:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788540908.828190:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788540908.828194:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788540908.829195:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788540908.829454:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788540908.829468:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788540908.829508:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788540908.829516:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788540908.829544:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788540908.829606:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788540908.829963:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788540908.829983:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:2.0:1788540908.829985:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:2.0:1788540908.830035:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788540908.830044:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788540908.830103:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788540908.830113:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:2.0:1788540908.830146:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788540908.830156:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788540908.830189:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788540908.830253:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788540908.830988:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788540908.831007:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.159@tcp 20000000:01000000:2.0:1788540908.831009:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.159@tcp (null) (null) (null) 00000040:00080000:2.0:1788540908.831044:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788540908.831052:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788540908.831081:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788540908.831089:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.159@tcp (null) (null) 00000040:00080000:2.0:1788540908.831118:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788540908.831127:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788540908.831186:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788540908.831226:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788540908.831242:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788540908.831246:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788540908.831252:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788540908.831254:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788540908.831256:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788540908.831270:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788540908.831273:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788540908.831305:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788540908.831307:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000100:00100000:1.0:1788540908.831805:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7869f4c00 going to sleep for 11 seconds 20000000:01000000:3.0:1788540908.836390:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788540908.836530:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788540908.836588:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788540908.837052:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788540908.837098:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788540908.837133:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788540908.837145:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788540908.837147:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788540908.837882:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788540908.838157:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788540908.838196:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788540908.838266:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788540908.838280:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788540908.838282:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788540908.839246:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788540908.839320:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788540908.839371:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788540908.840026:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788540908.840093:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788540908.840176:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788540908.840194:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788540908.840197:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788540908.841226:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788540908.841327:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788540908.841360:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788540908.841851:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788540908.841891:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788540908.841944:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1788540908.842188:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788540908.842208:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842227:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842236:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842243:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842250:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842256:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842277:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842317:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842332:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 16 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.842349:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400384:0@lo:104: 00000100:00100000:2.0:1788540908.842469:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540908.842522:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842531:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 16 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.842539:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400512:0@lo:104: 00010000:00010000:2.0:1788540908.842564:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842573:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 16 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.842581:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400640:0@lo:104: 00010000:00010000:2.0:1788540908.842606:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842614:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 16 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.842629:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400768:0@lo:104: 00010000:00010000:2.0:1788540908.842656:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.842663:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 16 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.842671:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400896:0@lo:104: 00000100:00100000:2.0:1788540908.842689:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bff64240 going to sleep for 11 seconds 00000100:00100000:0.0:1788540908.843658:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788540908.843688:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.843723:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.843732:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.843739:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.843751:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400384 00000100:00100000:0.0:1788540908.843759:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400384 00000100:00100000:0.0:1788540908.843792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400512 00000100:00100000:0.0:1788540908.843795:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400512 00000100:00100000:0.0:1788540908.843804:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400640 00000100:00100000:0.0:1788540908.843814:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400640 00000100:00100000:0.0:1788540908.843825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400768 00000100:00100000:0.0:1788540908.843827:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400768 00000100:00100000:0.0:1788540908.843835:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968400896 00000100:00100000:0.0:1788540908.843838:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968400896 00000100:00100000:0.0:1788540908.843849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540908.843858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d788fef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+7:5842:x1875420968400384:12345-0@lo:104: 00010000:00010000:0.0:1788540908.843871:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.843943:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540908.843950:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d788fef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+7:5842:x1875420968400384:12345-0@lo:104: Request processed in 94us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.843957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540908.844010:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540908.844017:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:5842:x1875420968400512:12345-0@lo:104: 00010000:00010000:0.0:1788540908.844025:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844056:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788540908.844061:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:5842:x1875420968400512:12345-0@lo:104: Request processed in 45us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.844066:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540908.844088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540908.844094:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5842:x1875420968400640:12345-0@lo:104: 00010000:00010000:0.0:1788540908.844101:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844124:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788540908.844135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:5842:x1875420968400640:12345-0@lo:104: Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.844141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540908.844152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540908.844158:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:5842:x1875420968400768:12345-0@lo:104: 00010000:00010000:0.0:1788540908.844165:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844191:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788540908.844195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:5842:x1875420968400768:12345-0@lo:104: Request processed in 38us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.844200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540908.844209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540908.844214:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5842:x1875420968400896:12345-0@lo:104: 00010000:00010000:0.0:1788540908.844220:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844239:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788540908.844243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5842:x1875420968400896:12345-0@lo:104: Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.844248:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788540908.844263:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788540908.844268:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844275:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540908.844279:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844297:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540908.844304:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540908.844309:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540908.844341:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844347:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540908.844364:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844372:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d781678600/0xc9a6a13d3cd1a8ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a906 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844386:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788540908.844389:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844395:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bda00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540908.844398:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844404:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540908.844447:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540908.844458:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540908.844471:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844476:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540908.844482:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844488:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bda00/0xc9a6a13d3cd1a8d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844498:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788540908.844501:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844507:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540908.844509:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844515:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540908.844520:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540908.844524:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540908.844534:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844539:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540908.844559:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844565:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1a8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844574:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788540908.844577:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844582:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540908.844584:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844590:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540908.844595:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540908.844600:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540908.844610:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844615:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540908.844619:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844625:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bc800/0xc9a6a13d3cd1a88f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a896 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844632:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540908.844641:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844646:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540908.844649:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844655:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540908.844660:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540908.844664:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540908.844674:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844679:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540908.844683:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844688:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1a865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a86c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.844700:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540908.844701:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540908.844703:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540908.844710:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540908.844728:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968401024:0@lo:103: 00000100:00100000:0.0:1788540908.844760:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.844788:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968401536:0@lo:103: 00000100:00100000:0.0:1788540908.844814:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.844832:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788540908.844837:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968401152:0@lo:103: 00000100:00100000:0.0:1788540908.844852:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.844874:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968401280:0@lo:103: 00000100:00100000:0.0:1788540908.844906:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.844923:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540908.844928:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968401408:0@lo:103: 00000100:00100000:0.0:1788540908.844945:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.844968:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401024 00000100:00100000:0.0:1788540908.844973:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401024 00010000:00010000:0.0:1788540908.844991:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 17 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540908.845006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401536 00000100:00100000:0.0:1788540908.845008:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401536 00010000:00010000:0.0:1788540908.845016:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 18 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540908.845023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401152 00000100:00100000:0.0:1788540908.845025:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401152 00010000:00010000:0.0:1788540908.845031:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 19 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540908.845039:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401280 00000100:00100000:0.0:1788540908.845041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401280 00010000:00010000:0.0:1788540908.845047:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 20 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540908.845055:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401408 00000100:00100000:0.0:1788540908.845064:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401408 00010000:00010000:0.0:1788540908.845076:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 21 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540908.845088:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540908.845095:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+21:3316:x1875420968401024:12345-0@lo:103: 00010000:00010000:0.0:1788540908.845105:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540908.845111:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 21 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845122:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 21 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845140:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540908.845169:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+21:3316:x1875420968401024:12345-0@lo:103: Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.845175:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540908.845188:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540908.845193:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+20:3316:x1875420968401536:12345-0@lo:103: 00010000:00010000:0.0:1788540908.845200:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540908.845205:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 20 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845211:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 20 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845220:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540908.845240:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+20:3316:x1875420968401536:12345-0@lo:103: Request processed in 47us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.845245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540908.845263:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540908.845268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968401152:12345-0@lo:103: 00010000:00010000:0.0:1788540908.845275:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540908.845281:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 19 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845288:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 19 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845297:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540908.845319:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968401152:12345-0@lo:103: Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.845325:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540908.845334:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540908.845341:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3314:x1875420968401280:12345-0@lo:103: 00010000:00010000:0.0:1788540908.845349:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540908.845353:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 18 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845361:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 18 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845369:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540908.845393:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3314:x1875420968401280:12345-0@lo:103: Request processed in 52us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.845398:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540908.845447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540908.845455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968401408:12345-0@lo:103: 00010000:00010000:0.0:1788540908.845462:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540908.845471:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 17 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845479:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 17 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845489:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845496:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845510:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845517:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845523:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845528:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845534:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fc000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788540908.845538:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845544:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845552:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.845570:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540908.845592:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968401408:12345-0@lo:103: Request processed in 139us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.845598:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540908.845641:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968401408:0@lo:103: 00000100:00100000:0.0:1788540908.845649:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968401280:0@lo:103: 00000100:00100000:0.0:1788540908.845673:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968401152:0@lo:103: 00000100:00100000:0.0:1788540908.845679:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968401024:0@lo:103: 00000100:00100000:0.0:1788540908.845685:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968401536:0@lo:103: 00010000:00010000:1.0:1788540908.845785:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1a906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8ff expref: 16 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.845797:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400384:0@lo:104: 00010000:00010000:1.0:1788540908.845807:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a8dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8d5 expref: 15 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.845816:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400512:0@lo:104: 00010000:00010000:1.0:1788540908.845825:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781679e00/0xc9a6a13d3cd1a8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8b9 expref: 14 pid: 5844 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.845833:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400640:0@lo:104: 00010000:00010000:1.0:1788540908.845841:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781679a00/0xc9a6a13d3cd1a896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a88f expref: 13 pid: 5842 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.845849:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400768:0@lo:104: 00010000:00010000:1.0:1788540908.845857:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1a86c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a865 expref: 12 pid: 5843 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.845864:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5842:1875420968400896:0@lo:104: 00010000:00010000:1.0:1788540908.845882:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.845890:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.845896:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.845907:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a91b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788540908.845919:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788540908.932229:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:7644:x1875420968400256:12345-0@lo:253: Request processed in 104083us (106658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.932245:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788540908.932455:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968400256:0@lo:253: 10000000:01000000:1.0:1788540908.932472:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788540908.932475:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788540908.932477:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540908.932478:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540908.932479:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788540908.932481:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540908.932482:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540908.932484:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540908.932485:0:7644:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788540908.932487:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540908.932488:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788540908.932509:0:7644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d7bf6df000 from lustre-OST0001 10000000:01000000:1.0:1788540908.932535:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788540908.932538:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788540908.932545:0:7644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d7b2f70000 local copy 10000000:01000000:1.0:1788540908.932550:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788540908.932600:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.932612:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.932622:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.932652:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968401664:0@lo:101: 00000100:00100000:1.0:1788540908.932702:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540908.932755:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540908.932890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401664 00000100:00100000:0.0:1788540908.932898:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401664 00000100:00100000:0.0:1788540908.932940:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788540908.932950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+11:7644:x1875420968401664:12345-0@lo:101: 00010000:00010000:0.0:1788540908.932962:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540908.932976:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a922 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.933001:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a922 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.933012:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a922 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.933021:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031000, rc 0) 00000100:00100000:0.0:1788540908.933062:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968401664:12345-0@lo:101: Request processed in 113us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.933085:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788540908.933275:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968401664:0@lo:101: 00010000:00010000:1.0:1788540908.933288:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.933297:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.933402:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968401792:0@lo:501: 00000100:00100000:1.0:1788540908.933470:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540908.933490:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540908.933589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401792 00000100:00100000:2.0:1788540908.933594:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401792 00000100:00100000:2.0:1788540908.933618:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788540908.933827:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968401792:12345-0@lo:501: 00000100:00100000:2.0:1788540908.934036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968401792:12345-0@lo:501: Request processed in 411us (565us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788540908.934043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788540908.934296:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968401792:0@lo:501: 10000000:01000000:1.0:1788540908.934310:0:7644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788540908.934336:0:7644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788540908.934342:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.934351:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.934357:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.934372:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788540908.934392:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d7bf6df000 10000000:01000000:1.0:1788540908.934398:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788540908.934403:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788540908.934445:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788540908.934450:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788540908.934453:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788540908.934473:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.934481:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.934488:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.934502:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968401920:0@lo:101: 00000100:00100000:1.0:1788540908.934529:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540908.934551:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378000 going to sleep for 11 seconds 00000100:00100000:2.0:1788540908.934764:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968401920 00000100:00100000:2.0:1788540908.934770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968401920 00000100:00100000:2.0:1788540908.934792:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788540908.934799:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968401920:12345-0@lo:101: 00010000:00010000:2.0:1788540908.934806:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540908.934815:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a930 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.934845:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.934853:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.934861:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fd000, rc 0) 00000100:00100000:2.0:1788540908.934900:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968401920:12345-0@lo:101: Request processed in 101us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.934906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788540908.934972:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968401920:0@lo:101: 00010000:00010000:1.0:1788540908.934985:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540908.934992:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540908.935049:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402048:0@lo:501: 00000100:00100000:1.0:1788540908.935082:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540908.935105:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378000 going to sleep for 11 seconds 00000100:00100000:2.0:1788540908.935208:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402048 00000100:00100000:2.0:1788540908.935212:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402048 00000100:00100000:2.0:1788540908.935229:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788540908.935235:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402048:12345-0@lo:501: 00000100:00100000:2.0:1788540908.935443:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402048:12345-0@lo:501: Request processed in 172us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.935450:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:0.0:1788540908.935525:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540908.935531:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.935539:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781679a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540908.935543:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.935551:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540908.935558:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540908.935564:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540908.935595:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.935602:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540908.935747:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.935756:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d781679a00/0xc9a6a13d3cd1a922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc9a6a13d3cd1a929 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.935769:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540908.935771:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540908.935773:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540908.935782:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788540908.935800:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968402176:0@lo:103: 00000100:00100000:0.0:1788540908.935831:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.935869:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402176 00000100:00100000:0.0:1788540908.935873:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402176 00000100:00100000:0.0:1788540908.935907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540908.935914:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:3316:x1875420968402176:12345-0@lo:103: 00010000:00010000:0.0:1788540908.935923:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540908.935934:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a922 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.935946:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540908.935973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3316:x1875420968402176:12345-0@lo:103: Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.935980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540908.936010:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968402176:0@lo:103: 00000100:00100000:1.0:1788540908.936194:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402048:0@lo:501: 00000100:00100000:1.0:1788540908.936225:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402304:0@lo:503: 00000100:00100000:1.0:1788540908.936264:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540908.936293:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378000 going to sleep for 11 seconds 00000100:00100000:2.0:1788540908.936346:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402304 00000100:00100000:2.0:1788540908.936350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402304 00000100:00100000:2.0:1788540908.936383:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788540908.936391:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402304:12345-0@lo:503: 00000100:00100000:2.0:1788540908.936894:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402304:12345-0@lo:503: Request processed in 503us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540908.936902:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788540908.937159:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402304:0@lo:503: 00000040:00080000:0.0:1788540908.937824:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540908.937897:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402432:0@lo:502: 00000100:00100000:0.0:1788540908.937955:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540908.938003:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631180 going to sleep for 11 seconds 00000100:00100000:1.0:1788540908.938284:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402432 00000100:00100000:1.0:1788540908.938292:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402432 00000100:00100000:1.0:1788540908.938333:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788540908.938342:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402432:12345-0@lo:502: 00000100:00100000:1.0:1788540908.938595:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402432:12345-0@lo:502: Request processed in 254us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540908.938602:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788540908.938747:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402432:0@lo:502: 00000040:00080000:3.0:1788540908.939011:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788540908.939062:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788540908.939115:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788540908.939166:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788540908.939204:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788540908.939239:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788540908.939266:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402560:0@lo:502: 00000100:00100000:3.0:1788540908.939308:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540908.939339:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d784f28f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540908.939592:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402560 00000100:00100000:1.0:1788540908.939598:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402560 00000100:00100000:1.0:1788540908.939621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788540908.939703:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402560:12345-0@lo:502: 00000100:00100000:1.0:1788540908.939847:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402560:12345-0@lo:502: Request processed in 218us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540908.939855:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788540908.940044:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad255880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402560:0@lo:502: 00000040:00080000:3.0:1788540908.940226:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788540908.940238:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788540908.940927:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788540908.940936:0:7651:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788540908.940942:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540908.940944:0:7651:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788540908.940950:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788540908.940966:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98d789060000) 00000020:00000080:1.0:1788540908.940988:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788540908.940995:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788540908.941064:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d7bf6df000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788540908.941150:0:7651:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788540908.941159:0:7651:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9a6a13d3cd1a945 00010000:00010000:1.0:1788540908.953714:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788540908.954830:0:7651:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788540908.972904:0:7651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788540908.974240:0:7651:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788540908.981280:0:7651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788540908.983386:0:7651:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788540908.990997:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788540908.991018:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540908.991026:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540908.991028:0:7651:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788540908.991033:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540908.991038:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540908.991040:0:7651:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540908.991043:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540908.991046:0:7651:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788540908.991219:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540908.991232:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540908.991234:0:7651:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540908.991238:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788540908.993358:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788540908.993400:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788540908.993481:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.993495:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540908.993505:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7bf6df000 from 1 10000000:01000000:2.0:1788540908.993508:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540908.993552:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.993561:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.993572:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.993597:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402688:0@lo:101: 00000100:00100000:2.0:1788540908.993756:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540908.993798:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bff64540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540908.994472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402688 00000100:00100000:0.0:1788540908.994482:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402688 00000100:00100000:0.0:1788540908.996673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788540908.996694:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:7644:x1875420968402688:12345-0@lo:101: 00010000:00010000:0.0:1788540908.996714:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540908.996732:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a94c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.996766:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.996778:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540908.996787:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031000, rc 0) 00000100:00100000:0.0:1788540908.996869:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402688:12345-0@lo:101: Request processed in 183us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540908.996877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788540908.998787:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402688:0@lo:101: 00010000:00010000:2.0:1788540908.998815:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540908.998829:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540908.998952:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402816:0@lo:501: 00000100:00100000:2.0:1788540908.999861:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540908.999938:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bff64540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540909.003174:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402816 00000100:00100000:0.0:1788540909.003191:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402816 00000100:00100000:0.0:1788540909.003289:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788540909.003300:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402816:12345-0@lo:501: 00000100:00100000:0.0:1788540909.003767:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402816:12345-0@lo:501: Request processed in 468us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540909.003776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788540909.003891:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402816:0@lo:501: 00000100:00100000:1.0:1788540909.003955:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402944:0@lo:503: 00000100:00100000:1.0:1788540909.004017:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540909.010718:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378900 going to sleep for 11 seconds 00000100:00100000:2.0:1788540909.011168:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968402944 00000100:00100000:2.0:1788540909.011180:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968402944 00000100:00100000:2.0:1788540909.012895:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788540909.012908:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402944:12345-0@lo:503: 00000100:00100000:2.0:1788540909.015500:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968402944:12345-0@lo:503: Request processed in 2585us (11472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540909.015517:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788540909.021184:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968402944:0@lo:503: 00000040:00080000:0.0:1788540909.023231:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540909.023338:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403072:0@lo:502: 00000100:00100000:0.0:1788540909.024065:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.024248:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631300 going to sleep for 11 seconds 00000100:00100000:2.0:1788540909.027971:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403072 00000100:00100000:2.0:1788540909.027989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403072 00000100:00100000:3.0:1788540909.028132:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788540909.028145:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968403072:12345-0@lo:502: 00000100:00100000:3.0:1788540909.028478:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968403072:12345-0@lo:502: Request processed in 335us (4412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540909.028486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788540909.028756:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403072:0@lo:502: 00000040:00080000:0.0:1788540909.029032:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788540909.029102:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788540909.029139:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403200:0@lo:502: 00000100:00100000:0.0:1788540909.029184:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.029222:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631300 going to sleep for 11 seconds 00000100:00100000:3.0:1788540909.029323:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403200 00000100:00100000:3.0:1788540909.029329:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403200 00000100:00100000:3.0:1788540909.029368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788540909.029375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968403200:12345-0@lo:502: 00000100:00100000:3.0:1788540909.029937:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968403200:12345-0@lo:502: Request processed in 561us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540909.029946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788540909.030355:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403200:0@lo:502: 00000040:00080000:0.0:1788540909.030507:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788540909.030520:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788540909.031315:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540909.031325:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540909.031328:0:7655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788540909.031335:0:7655:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d7bf6df000 00000020:00000080:3.0:1788540909.031337:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788540909.031356:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540909.031359:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540909.031360:0:7655:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788540909.031363:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788540909.031479:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788540909.031500:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788540909.031693:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540909.031705:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540909.031746:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788540909.031749:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d7bf6df000 10000000:01000000:0.0:1788540909.031752:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d7bf6df000 10000000:01000000:0.0:1788540909.031755:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788540909.031761:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d7bf6df000 from 1 10000000:01000000:0.0:1788540909.031763:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788540909.031792:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540909.031814:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540909.031825:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540909.031844:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403328:0@lo:101: 00000100:00100000:0.0:1788540909.031894:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.032061:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540909.035253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403328 00000100:00100000:2.0:1788540909.035273:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403328 00000100:00100000:3.0:1788540909.039303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788540909.039326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968403328:12345-0@lo:101: 00010000:00010000:3.0:1788540909.039344:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540909.039361:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a95a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540909.039388:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540909.039399:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540909.039455:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bc400, rc 0) 00000100:00100000:3.0:1788540909.039539:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403328:12345-0@lo:101: Request processed in 216us (7644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540909.039544:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788540909.039644:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403328:0@lo:101: 00010000:00010000:0.0:1788540909.039663:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540909.039673:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540909.039791:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403456:0@lo:501: 00000100:00100000:0.0:1788540909.039824:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.047361:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540909.048644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403456 00000100:00100000:2.0:1788540909.048657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403456 00000100:00100000:2.0:1788540909.048715:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788540909.048725:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403456:12345-0@lo:501: 00000100:00100000:2.0:1788540909.049848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403456:12345-0@lo:501: Request processed in 1119us (10017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540909.049860:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788540909.055301:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403456:0@lo:501: 00000100:00100000:0.0:1788540909.055398:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403584:0@lo:503: 00000100:00100000:0.0:1788540909.055821:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.055853:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540909.055913:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403584 00000100:00100000:2.0:1788540909.055920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403584 00000100:00100000:2.0:1788540909.056044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788540909.056054:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403584:12345-0@lo:503: 00000100:00100000:2.0:1788540909.056273:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403584:12345-0@lo:503: Request processed in 219us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540909.056280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788540909.056353:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403584:0@lo:503: 00000040:00080000:0.0:1788540909.058731:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540909.058824:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403712:0@lo:502: 00000100:00100000:0.0:1788540909.058894:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.064545:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540909.065879:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403712 00000100:00100000:1.0:1788540909.065893:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403712 00000100:00100000:1.0:1788540909.065953:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788540909.065977:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403712:12345-0@lo:502: 00000100:00100000:1.0:1788540909.066340:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403712:12345-0@lo:502: Request processed in 364us (7444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540909.066348:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788540909.066854:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403712:0@lo:502: 00000040:00080000:0.0:1788540909.067178:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788540909.067237:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788540909.067272:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788540909.067319:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788540909.067354:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788540909.067442:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788540909.067483:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788540909.067519:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788540909.067580:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788540909.067617:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788540909.067790:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788540909.067843:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788540909.067877:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788540909.067910:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788540909.067962:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788540909.067998:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788540909.068031:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788540909.068081:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788540909.068118:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788540909.068160:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788540909.068213:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788540909.068249:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788540909.068283:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788540909.068331:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788540909.068372:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788540909.068439:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788540909.068591:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788540909.068728:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788540909.068769:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788540909.068819:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788540909.068857:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788540909.068893:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788540909.068927:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788540909.068977:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788540909.069013:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788540909.069061:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788540909.069099:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788540909.069150:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403840:0@lo:502: 00000100:00100000:0.0:1788540909.069223:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.069270:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540909.069278:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403840 00000100:00100000:1.0:1788540909.069288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403840 00000100:00100000:1.0:1788540909.069365:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788540909.069375:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403840:12345-0@lo:502: 00000100:00100000:1.0:1788540909.069628:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968403840:12345-0@lo:502: Request processed in 253us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540909.069636:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788540909.069731:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968403840:0@lo:502: 00000040:00080000:0.0:1788540909.069795:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788540909.069803:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788540909.074499:0:7656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788540909.074518:0:7656:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98d7ae250000) 00000020:00000080:3.0:1788540909.074608:0:7656:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788540909.074763:0:7656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d7bf6df000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788540909.074767:0:7656:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d7bf6df000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788540909.074770:0:7656:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7bf6df000 3 00010000:00080000:3.0:1788540909.074799:0:7656:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7bf70c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1788540909.083852:0:7656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788540909.084288:0:7656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788540909.084335:0:7656:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788540909.084348:0:7656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc9a6a13d3cd1a96f 00000100:00080000:1.0:1788540909.084358:0:7656:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540909.084366:0:7656:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98d7bf70c000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:1.0:1788540909.084441:0:7656:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d78904c000 x1875420968403968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788540909.084478:0:7656:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788540909.084824:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875420968403968:0@lo:38: 00000100:00100000:3.0:1788540909.084898:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.086955:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968404096:0@lo:400: 00000100:00100000:0.0:1788540909.087041:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.087080:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540909.087087:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968404224:0@lo:400: 00000100:00100000:0.0:1788540909.087107:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.087133:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968404352:0@lo:400: 00000100:00100000:0.0:1788540909.087156:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.087186:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968403968 00000100:00100000:0.0:1788540909.087195:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968403968 00000100:00100000:0.0:1788540909.087221:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404096 00000100:00100000:0.0:1788540909.087223:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404096 00000100:00100000:0.0:1788540909.087242:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404224 00000100:00100000:0.0:1788540909.087245:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404224 00000100:00100000:0.0:1788540909.087275:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540909.087283:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968404096:12345-0@lo:400: 00000100:00100000:0.0:1788540909.087331:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968404096:12345-0@lo:400: Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540909.087338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540909.087353:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540909.087359:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968404224:12345-0@lo:400: 00000100:00100000:0.0:1788540909.087384:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968404224:12345-0@lo:400: Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540909.087390:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540909.087401:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788540909.087405:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875420968403968:12345-0@lo:38: 00010000:00080000:0.0:1788540909.087458:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1788540909.087508:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc9a6a13d3cd1a976 00000004:00100000:0.0:1788540909.087710:0:5852:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788540909.087745:0:5852:0:(import.c:65:import_set_state_nolock()) ffff98d7899d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540909.087785:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875420968403968:12345-0@lo:38: Request processed in 378us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540909.087791:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788540909.087831:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d68130bb80 x1875420968404224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540909.087846:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968404224:0@lo:400: 00010000:00080000:0.0:1788540909.087858:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d681308000 x1875420968404096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540909.087866:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968404096:0@lo:400: 00010000:00080000:3.0:1788540909.087997:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d78904c000 x1875420968403968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540909.088007:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788540909.088014:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788540909.088029:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788540909.088035:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788540909.088039:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7bf70c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788540909.088045:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875420968403968:0@lo:38: 00000100:00100000:1.0:1788540909.088485:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404352 00000100:00100000:1.0:1788540909.088503:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404352 00000100:00100000:1.0:1788540909.088556:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540909.088566:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968404352:12345-0@lo:400: 00000100:00100000:1.0:1788540909.088839:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968404352:12345-0@lo:400: Request processed in 273us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540909.088846:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:1.0:1788540909.089022:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788540909.089454:0:7657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7657:1875420968404480:0@lo:901: 00000100:00100000:3.0:1788540909.089515:0:7657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540909.089549:0:7657:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d784f28480 going to sleep for 11 seconds 00010000:00080000:0.0:1788540909.089868:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d681308700 x1875420968404352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540909.089883:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968404352:0@lo:400: 00000020:01000000:0.0:1788540909.089912:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788540909.089942:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540909.089985:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540909.089997:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788540909.090051:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788540909.090054:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788540909.090055:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540909.090057:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540909.090058:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540909.090060:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540909.090062:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540909.090063:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540909.090065:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540909.090067:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540909.090069:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788540909.090074:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788540909.090077:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788540909.090078:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788540909.090080:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540909.090081:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540909.090082:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540909.090083:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540909.090084:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540909.090086:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540909.090087:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540909.090088:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540909.090089:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788540909.090109:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788540909.090124:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968404608:0@lo:253: 00000100:00100000:0.0:1788540909.090169:0:7644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540909.090202:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631300 going to sleep for 11 seconds 00000100:00100000:1.0:1788540909.090896:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404480 00000100:00100000:1.0:1788540909.090903:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404480 00000100:00100000:1.0:1788540909.090982:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540909.090992:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7657:x1875420968404480:12345-0@lo:901: 00000100:00100000:1.0:1788540909.091321:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7657:x1875420968404480:12345-0@lo:901: Request processed in 329us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540909.091329:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788540909.091957:0:7657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7ad257480 x1875420968404480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788540925 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540909.091988:0:7657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7657:1875420968404480:0@lo:901: 00000100:00080000:0.0:1788540909.092268:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540909.093685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404608 00000100:00100000:3.0:1788540909.093701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404608 00000100:00100000:3.0:1788540909.093765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788540909.093775:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7644:x1875420968404608:12345-0@lo:253: 20000000:01000000:3.0:1788540909.093866:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788540909.093881:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1788540909.145644:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788540909.166001:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788540909.166022:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788540909.166217:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788540909.166222:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788540909.166245:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.166277:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.166286:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.166325:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.166339:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 14 pid: 5844 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540909.166353:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875420968404736:0@lo:104: 00000100:00100000:2.0:1788540909.166469:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540909.166542:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78edb5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540909.166859:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404736 00000100:00100000:1.0:1788540909.166868:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404736 00000100:00100000:1.0:1788540909.166924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788540909.166934:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5866:x1875420968404736:12345-0@lo:104: 00010000:00010000:1.0:1788540909.166948:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167015:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788540909.167021:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:5866:x1875420968404736:12345-0@lo:104: Request processed in 89us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540909.167037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788540909.167058:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540909.167064:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167071:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781679600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540909.167076:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167084:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540909.167092:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540909.167098:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540909.167128:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167136:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540909.167155:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167162:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d781679600/0xc9a6a13d3cd1a8c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a8ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167179:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540909.167181:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540909.167183:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540909.167195:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968404864:0@lo:103: 00000100:00100000:1.0:1788540909.167237:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540909.167274:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404864 00000100:00100000:1.0:1788540909.167278:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404864 00010000:00010000:1.0:1788540909.167295:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 15 pid: 5844 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540909.167316:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788540909.167322:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78316e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3317:x1875420968404864:12345-0@lo:103: 00010000:00010000:1.0:1788540909.167333:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540909.167339:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 15 pid: 5844 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167349:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 15 pid: 5844 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167364:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167371:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788540909.167383:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006467228s 00010000:00010000:1.0:1788540909.167388:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167395:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167403:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167467:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167472:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fda00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788540909.167477:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167494:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167504:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540909.167514:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540909.167548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78316e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3317:x1875420968404864:12345-0@lo:103: Request processed in 226us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540909.167554:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788540909.167613:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968404864:0@lo:103: 00010000:00010000:2.0:1788540909.168112:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a8ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a8c7 expref: 14 pid: 5844 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540909.168124:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875420968404736:0@lo:104: 00010000:00010000:2.0:1788540909.168139:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.168149:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.168154:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540909.168160:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a97d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540909.182572:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:7644:x1875420968404608:12345-0@lo:253: Request processed in 88788us (92391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540909.182588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788540909.182795:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6c6c881b-c5d1-4767-bf18-6c64f558276e:7644:1875420968404608:0@lo:253: 10000000:01000000:0.0:1788540909.183443:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788540909.183447:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788540909.183449:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788540909.183450:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540909.183451:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540909.183452:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540909.183453:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540909.183455:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788540909.183456:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540909.183458:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540909.183459:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540909.183460:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788540909.183478:0:7644:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788540909.204938:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788540909.205152:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788540909.205364:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788540909.205583:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788540909.207194:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788540909.207497:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788540909.215395:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788540909.384470:0:7644:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788540909.384479:0:7644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788540909.384603:0:7644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788540909.384666:0:7644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788540909.384682:0:7644:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788540909.384714:0:7644:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788540910.167774:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540911.191876:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540912.216358:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540913.242453:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540913.626787:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788540913.626814:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968404992:0@lo:13: 00000100:00100000:1.0:1788540913.626890:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540913.626971:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968404992 00000100:00100000:1.0:1788540913.626979:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968404992 00000100:00100000:1.0:1788540913.627040:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540913.627051:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968404992:12345-0@lo:13: 00002000:00000024:1.0:1788540913.627087:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540913.627149:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968404992:12345-0@lo:13: Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540913.627157:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788540913.627179:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788540913.627213:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904fb80 x1875420968404992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540913.627232:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968404992:0@lo:13: 00000100:00100000:1.0:1788540914.143138:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968405120:0@lo:400: 00000100:00100000:1.0:1788540914.143257:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540914.143300:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968405632:0@lo:400: 00000100:00100000:1.0:1788540914.143341:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540914.143386:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788540914.143393:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968405504:0@lo:400: 00000100:00100000:1.0:1788540914.143432:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540914.143458:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968405248:0@lo:400: 00000100:00100000:1.0:1788540914.143479:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540914.143496:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540914.143501:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968405376:0@lo:400: 00000100:00100000:1.0:1788540914.143533:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540914.143565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405120 00000100:00100000:1.0:1788540914.143572:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405120 00000100:00100000:1.0:1788540914.143617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788540914.143627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:3315:x1875420968405120:12345-0@lo:400: 00000100:00100000:1.0:1788540914.143677:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:3315:x1875420968405120:12345-0@lo:400: Request processed in 52us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.143683:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788540914.143713:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405632 00000100:00100000:1.0:1788540914.143716:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405632 00000100:00100000:1.0:1788540914.143742:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405248 00000100:00100000:1.0:1788540914.143745:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405248 00000100:00100000:1.0:1788540914.143757:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405376 00000100:00100000:1.0:1788540914.143759:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405376 00000100:00100000:1.0:1788540914.143774:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540914.143779:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968405632:12345-0@lo:400: 00000100:00100000:1.0:1788540914.143810:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968405632:12345-0@lo:400: Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.143816:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540914.143828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540914.143834:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968405248:12345-0@lo:400: 00000100:00100000:1.0:1788540914.143863:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968405248:12345-0@lo:400: Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.143868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540914.143879:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540914.143886:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968405376:12345-0@lo:400: 00000100:00100000:1.0:1788540914.143912:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968405376:12345-0@lo:400: Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.143924:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540914.143943:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405504 00000100:00100000:1.0:1788540914.143946:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405504 00000100:00100000:1.0:1788540914.143970:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540914.143976:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968405504:12345-0@lo:400: 00000100:00100000:1.0:1788540914.144006:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968405504:12345-0@lo:400: Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.144012:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788540914.144036:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788540914.144065:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca2680 x1875420968405376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540914.144078:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968405376:0@lo:400: 00010000:00080000:1.0:1788540914.144089:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca2d80 x1875420968405248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540914.144097:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968405248:0@lo:400: 00010000:00080000:1.0:1788540914.144124:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca3100 x1875420968405504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540914.144132:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968405504:0@lo:400: 00000100:00100000:1.0:1788540914.144141:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968405120:0@lo:400: 00010000:00080000:1.0:1788540914.144150:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca3b80 x1875420968405632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540914.144158:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968405632:0@lo:400: 00010000:00010000:2.0:1788540914.263579:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788540914.647512:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540914.647523:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d7831d9800 from 30 10000000:01000000:3.0:1788540914.647539:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540914.647586:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.647598:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.647622:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540914.647647:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968405760:0@lo:101: 00000100:00100000:3.0:1788540914.647716:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.647777:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.648658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405760 00000100:00100000:2.0:1788540914.648667:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405760 00000100:00100000:2.0:1788540914.648712:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788540914.648721:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968405760:12345-0@lo:101: 00010000:00010000:2.0:1788540914.648736:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540914.648749:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a984 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.648775:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.648785:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.648794:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fc000, rc 0) 00000100:00100000:2.0:1788540914.648844:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968405760:12345-0@lo:101: Request processed in 123us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.648850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788540914.648914:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968405760:0@lo:101: 00010000:00010000:3.0:1788540914.648933:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.648942:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540914.648999:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968405888:0@lo:501: 00000100:00100000:3.0:1788540914.649026:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.649060:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.649396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968405888 00000100:00100000:2.0:1788540914.649400:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968405888 00000100:00100000:2.0:1788540914.649440:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788540914.649447:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968405888:12345-0@lo:501: 00000100:00100000:2.0:1788540914.649751:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968405888:12345-0@lo:501: Request processed in 304us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.649769:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788540914.651580:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968405888:0@lo:501: 00000100:00100000:3.0:1788540914.651633:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406016:0@lo:503: 00000100:00100000:3.0:1788540914.651700:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.651743:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.651772:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406016 00000100:00100000:2.0:1788540914.651778:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406016 00000100:00100000:2.0:1788540914.651829:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788540914.651837:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968406016:12345-0@lo:503: 00000100:00100000:2.0:1788540914.652158:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968406016:12345-0@lo:503: Request processed in 321us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.652166:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788540914.652471:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406016:0@lo:503: 00000100:00100000:3.0:1788540914.660721:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7932:1875420968406144:0@lo:502: 00000100:00100000:3.0:1788540914.660800:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.660834:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519300 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.660971:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406144 00000100:00100000:2.0:1788540914.660977:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406144 00000100:00100000:2.0:1788540914.661016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788540914.661022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7932:x1875420968406144:12345-0@lo:502: 00000100:00100000:2.0:1788540914.661374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7932:x1875420968406144:12345-0@lo:502: Request processed in 341us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.661381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788540914.661976:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7932:1875420968406144:0@lo:502: 00000100:00100000:0.0:1788540914.662037:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7932:1875420968406272:0@lo:502: 00000100:00100000:0.0:1788540914.662079:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.662105:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b3783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540914.662278:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406272 00000100:00100000:3.0:1788540914.662283:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406272 00000100:00100000:3.0:1788540914.662318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788540914.662337:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7932:x1875420968406272:12345-0@lo:502: 00000100:00100000:3.0:1788540914.662554:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:7932:x1875420968406272:12345-0@lo:502: Request processed in 217us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540914.662561:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788540914.662753:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7932:1875420968406272:0@lo:502: 00000040:00080000:0.0:1788540914.662776:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788540914.662981:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788540914.663000:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788540914.663010:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.663020:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540914.663030:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788540914.663035:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788540914.663037:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540914.663066:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.663073:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.663083:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540914.663095:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406400:0@lo:101: 00000100:00100000:3.0:1788540914.663122:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.663157:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519540 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.663210:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406400 00000100:00100000:2.0:1788540914.663215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406400 00000100:00100000:2.0:1788540914.663247:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788540914.663255:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968406400:12345-0@lo:101: 00010000:00010000:2.0:1788540914.663263:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540914.663275:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a992 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.663296:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.663318:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.663326:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fda00, rc 0) 00000100:00100000:2.0:1788540914.663374:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968406400:12345-0@lo:101: Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.663380:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788540914.663873:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406400:0@lo:101: 00010000:00010000:3.0:1788540914.663899:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.663908:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540914.663959:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406528:0@lo:501: 00000100:00100000:3.0:1788540914.663986:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.664017:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.664108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406528 00000100:00100000:0.0:1788540914.664113:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406528 00000100:00100000:0.0:1788540914.664148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788540914.664155:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968406528:12345-0@lo:501: 00000100:00100000:0.0:1788540914.664430:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968406528:12345-0@lo:501: Request processed in 274us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.664437:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788540914.664474:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406528:0@lo:501: 00000100:00100000:0.0:1788540914.664501:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406656:0@lo:503: 00000100:00100000:0.0:1788540914.664951:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.664975:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.664988:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406656 00000100:00100000:0.0:1788540914.664993:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406656 00000100:00100000:0.0:1788540914.665017:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788540914.665023:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968406656:12345-0@lo:503: 00000100:00100000:0.0:1788540914.665306:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968406656:12345-0@lo:503: Request processed in 282us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.665313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788540914.665361:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968406656:0@lo:503: 00000100:00100000:2.0:1788540914.668008:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7933:1875420968406784:0@lo:502: 00000100:00100000:2.0:1788540914.668082:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540914.668134:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786073900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540914.668190:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406784 00000100:00100000:3.0:1788540914.668195:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406784 00000100:00100000:3.0:1788540914.668338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788540914.668349:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:7933:x1875420968406784:12345-0@lo:502: 00000100:00100000:3.0:1788540914.668656:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:7933:x1875420968406784:12345-0@lo:502: Request processed in 309us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540914.668664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788540914.668745:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7933:1875420968406784:0@lo:502: 00000020:01000000:0.0:1788540914.668774:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540914.668783:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540914.668785:0:7933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540914.668790:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540914.668792:0:7933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788540914.668809:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7933:1875420968406912:0@lo:502: 00000100:00100000:0.0:1788540914.668842:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.672795:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.672849:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968406912 00000100:00100000:2.0:1788540914.672858:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968406912 00000100:00100000:2.0:1788540914.672905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788540914.672915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:7933:x1875420968406912:12345-0@lo:502: 00000100:00100000:2.0:1788540914.673685:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:7933:x1875420968406912:12345-0@lo:502: Request processed in 769us (4840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.673694:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788540914.675254:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7933:1875420968406912:0@lo:502: 00000020:01000000:0.0:1788540914.675292:0:7933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540914.675300:0:7933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540914.675302:0:7933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540914.675306:0:7933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788540914.675500:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788540914.675521:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788540914.675600:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.675672:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540914.675686:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540914.675690:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d782e54800 from 30 10000000:01000000:3.0:1788540914.675693:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540914.675727:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.675747:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.675757:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540914.675778:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407040:0@lo:101: 00000100:00100000:3.0:1788540914.675833:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.675875:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.675934:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407040 00000100:00100000:0.0:1788540914.675942:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407040 00000100:00100000:0.0:1788540914.675991:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788540914.676001:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968407040:12345-0@lo:101: 00010000:00010000:0.0:1788540914.676014:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540914.676026:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a9a0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.676050:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.676060:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.676070:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030400, rc 0) 00000100:00100000:0.0:1788540914.676111:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968407040:12345-0@lo:101: Request processed in 111us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.676118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788540914.676157:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407040:0@lo:101: 00010000:00010000:0.0:1788540914.676171:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.676180:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540914.676238:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407168:0@lo:501: 00000100:00100000:0.0:1788540914.676262:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.676275:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.676287:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407168 00000100:00100000:0.0:1788540914.676290:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407168 00000100:00100000:0.0:1788540914.676311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788540914.676317:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968407168:12345-0@lo:501: 00000100:00100000:0.0:1788540914.676722:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968407168:12345-0@lo:501: Request processed in 404us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.676730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788540914.676760:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407168:0@lo:501: 00000100:00100000:0.0:1788540914.676788:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407296:0@lo:503: 00000100:00100000:0.0:1788540914.676824:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.676843:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.676854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407296 00000100:00100000:0.0:1788540914.676858:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407296 00000100:00100000:0.0:1788540914.676878:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788540914.676884:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968407296:12345-0@lo:503: 00000100:00100000:0.0:1788540914.677019:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968407296:12345-0@lo:503: Request processed in 134us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.677025:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788540914.677061:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407296:0@lo:503: 00000100:00100000:0.0:1788540914.677218:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7934:1875420968407424:0@lo:502: 00000100:00100000:0.0:1788540914.677249:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.677272:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407424 00000100:00100000:0.0:1788540914.677276:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407424 00000100:00100000:0.0:1788540914.677297:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788540914.677303:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:7934:x1875420968407424:12345-0@lo:502: 00000100:00100000:0.0:1788540914.677480:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:7934:x1875420968407424:12345-0@lo:502: Request processed in 176us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.677487:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788540914.677516:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.677750:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7934:1875420968407424:0@lo:502: 00000100:00100000:0.0:1788540914.677795:0:7934:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7934:1875420968407552:0@lo:502: 00000100:00100000:0.0:1788540914.677828:0:7934:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.677846:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407552 00000100:00100000:0.0:1788540914.677850:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407552 00000100:00100000:0.0:1788540914.677871:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788540914.677877:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:7934:x1875420968407552:12345-0@lo:502: 00000100:00100000:0.0:1788540914.677995:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:7934:x1875420968407552:12345-0@lo:502: Request processed in 117us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.678002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788540914.678029:0:7934:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.678039:0:7934:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7934:1875420968407552:0@lo:502: 00000040:00080000:0.0:1788540914.678056:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788540914.678105:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788540914.678118:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540914.678126:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.678135:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540914.678151:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788540914.678154:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d782e54800 from 5 10000000:01000000:0.0:1788540914.678156:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540914.678180:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.678187:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.678197:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540914.678207:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407680:0@lo:101: 00000100:00100000:0.0:1788540914.678230:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.678255:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788540914.678559:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407680 00000100:00100000:3.0:1788540914.678564:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407680 00000100:00100000:3.0:1788540914.678597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788540914.678605:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968407680:12345-0@lo:101: 00010000:00010000:3.0:1788540914.678767:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540914.678780:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bd800/0xc9a6a13d3cd1a9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a9ae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.678800:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bd800/0xc9a6a13d3cd1a9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9ae expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.678810:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bd800/0xc9a6a13d3cd1a9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9ae expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.678818:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd800, rc 0) 00000100:00100000:3.0:1788540914.678861:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968407680:12345-0@lo:101: Request processed in 256us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540914.678867:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788540914.678940:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407680:0@lo:101: 00010000:00010000:2.0:1788540914.678952:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.678961:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540914.679010:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407808:0@lo:256: 00000100:00100000:2.0:1788540914.679041:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540914.679065:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c6b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.679131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407808 00000100:00100000:0.0:1788540914.679136:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407808 00000100:00100000:0.0:1788540914.679164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788540914.679172:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968407808:12345-0@lo:256: 20000000:01000000:0.0:1788540914.679185:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788540914.679201:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788540914.679204:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788540914.679276:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968407808:12345-0@lo:256: Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.679283:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788540914.679443:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407808:0@lo:256: 10000000:01000000:3.0:1788540914.679485:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788540914.679491:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.679498:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540914.679506:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788540914.679508:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788540914.679511:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540914.679527:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.679600:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540914.679608:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540914.679683:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407936:0@lo:101: 00000100:00100000:3.0:1788540914.679709:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.679780:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.680968:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968407936 00000100:00100000:2.0:1788540914.680978:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968407936 00000100:00100000:2.0:1788540914.681023:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788540914.681032:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968407936:12345-0@lo:101: 00010000:00010000:2.0:1788540914.681042:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540914.681056:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a9bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.681078:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.681088:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.681096:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fdc00, rc 0) 00000100:00100000:2.0:1788540914.681146:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968407936:12345-0@lo:101: Request processed in 115us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.681152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788540914.681198:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968407936:0@lo:101: 00010000:00010000:2.0:1788540914.681213:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540914.681223:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540914.681280:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408064:0@lo:501: 00000100:00100000:2.0:1788540914.681307:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540914.681330:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786478cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.681350:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408064 00000100:00100000:2.0:1788540914.681353:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408064 00000100:00100000:2.0:1788540914.681386:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788540914.681392:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968408064:12345-0@lo:501: 00000100:00100000:2.0:1788540914.681776:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968408064:12345-0@lo:501: Request processed in 383us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.681783:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788540914.681814:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408064:0@lo:501: 00000100:00100000:2.0:1788540914.681841:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408192:0@lo:503: 00000100:00100000:2.0:1788540914.681876:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540914.681889:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786478cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.681900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408192 00000100:00100000:2.0:1788540914.681903:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408192 00000100:00100000:2.0:1788540914.681923:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788540914.681929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968408192:12345-0@lo:503: 00000100:00100000:2.0:1788540914.682192:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968408192:12345-0@lo:503: Request processed in 263us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540914.682200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788540914.682238:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408192:0@lo:503: 00000100:00100000:2.0:1788540914.682744:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7935:1875420968408320:0@lo:502: 00000100:00100000:2.0:1788540914.682780:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540914.682809:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782d99900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.682854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408320 00000100:00100000:0.0:1788540914.682859:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408320 00000100:00100000:0.0:1788540914.682891:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788540914.682906:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:7935:x1875420968408320:12345-0@lo:502: 00000100:00100000:0.0:1788540914.683121:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:7935:x1875420968408320:12345-0@lo:502: Request processed in 216us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.683128:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788540914.683165:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7935:1875420968408320:0@lo:502: 00000020:01000000:0.0:1788540914.683187:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788540914.683194:0:7935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788540914.683201:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540914.683203:0:7935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788540914.683207:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788540914.683212:0:7935:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:0.0:1788540914.683234:0:7935:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788540914.683237:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788540914.683259:0:7935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98d7ada7cd40) 00000020:00000080:0.0:1788540914.683280:0:7935:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788540914.683286:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788540914.683353:0:7935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788540914.683359:0:7935:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788540914.683386:0:7935:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1a9d1 00010000:00080000:0.0:1788540914.683457:0:7935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7ae090000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1788540914.684025:0:7935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788540914.684332:0:7935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788540914.684343:0:7935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788540914.684927:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540914.685078:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540914.685128:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788540914.685180:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788540914.689314:0:7936:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788540914.689323:0:7936:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788540914.691315:0:7935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788540914.691330:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788540914.691382:0:7935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788540914.691406:0:7935:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1a9d8 00000100:00080000:0.0:1788540914.691439:0:7935:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788540914.691445:0:7935:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d7ae090000 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788540914.691482:0:7935:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d681308000 x1875420968408448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788540914.691509:0:7935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788540914.691697:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540914.691702:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540914.691704:0:7935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788540914.691707:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540914.691711:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540914.691712:0:7935:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540914.691715:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540914.691717:0:7935:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788540914.691744:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7935:1875420968408576:0@lo:502: 00000100:00100000:0.0:1788540914.691821:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.691856:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782d3f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.691876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408576 00000100:00100000:0.0:1788540914.691883:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408576 00000100:00100000:0.0:1788540914.691918:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788540914.691927:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:7935:x1875420968408576:12345-0@lo:502: 00000100:00100000:0.0:1788540914.692160:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:7935:x1875420968408576:12345-0@lo:502: Request processed in 233us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.692168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788540914.692220:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:7935:1875420968408576:0@lo:502: 00000020:01000000:0.0:1788540914.692242:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540914.692245:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540914.692247:0:7935:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540914.692254:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788540914.692356:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788540914.692381:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788540914.692391:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.692401:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540914.692436:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788540914.692439:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d7b2f70000 from 1 10000000:01000000:0.0:1788540914.692442:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788540914.692465:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.692473:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.692482:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540914.692494:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408704:0@lo:101: 00000100:00100000:0.0:1788540914.692520:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540914.692647:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968408448:0@lo:8: 00000100:00100000:3.0:1788540914.692681:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540914.692850:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408448 00000100:00100000:1.0:1788540914.692862:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408448 00000100:00100000:1.0:1788540914.692896:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540914.692903:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1875420968408448:12345-0@lo:8: 00010000:00080000:1.0:1788540914.692923:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788540914.692945:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1a9e6 00002000:00100000:1.0:1788540914.692960:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98d7bf57f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788540914.692964:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788540914.692968:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788540914.693078:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788540914.693201:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788540914.693220:0:6705:0:(import.c:65:import_set_state_nolock()) ffff98d7bf57c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540914.693256:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875420968408448:12345-0@lo:8: Request processed in 353us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.693261:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788540914.693295:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d681308000 x1875420968408448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788540924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540914.693305:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540914.693312:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788540914.693319:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788540914.693324:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788540914.693326:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7ae090000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788540914.693337:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788540914.693342:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968408448:0@lo:8: 00000004:00080000:3.0:1788540914.693494:0:7936:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788540914.693590:0:7936:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199693180726ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788540914.709314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408704 00000100:00100000:0.0:1788540914.709330:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408704 00000100:00100000:0.0:1788540914.709396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788540914.709422:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968408704:12345-0@lo:101: 00010000:00010000:0.0:1788540914.709444:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540914.709466:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1a9df expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.709511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.709524:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.709544:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031e00, rc 0) 00000100:00100000:0.0:1788540914.709740:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968408704:12345-0@lo:101: Request processed in 334us (17218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.709747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788540914.709802:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.709827:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408704:0@lo:101: 00010000:00010000:0.0:1788540914.709845:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.709855:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540914.709933:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408832:0@lo:501: 00000100:00100000:0.0:1788540914.709966:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.709990:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408832 00000100:00100000:0.0:1788540914.709994:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408832 00000100:00100000:0.0:1788540914.710014:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788540914.710020:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968408832:12345-0@lo:501: 00000100:00100000:0.0:1788540914.710243:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968408832:12345-0@lo:501: Request processed in 222us (276us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788540914.710257:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788540914.710284:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.710294:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968408832:0@lo:501: 10000000:01000000:0.0:1788540914.710316:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788540914.710323:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540914.710331:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788540914.785546:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788540914.841540:0:7937:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788540914.841582:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409088:0@lo:7: 00000100:00100000:0.0:1788540914.841666:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.841716:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540914.842764:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788540914.842789:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968408960:0@lo:13: 00000100:00100000:2.0:1788540914.842845:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.842949:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968408960 00000100:00100000:0.0:1788540914.842958:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968408960 00000100:00100000:0.0:1788540914.843062:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540914.843073:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968408960:12345-0@lo:13: 00002000:00000024:0.0:1788540914.843117:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788540914.843168:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968408960:12345-0@lo:13: Request processed in 97us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540914.843175:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788540914.843222:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788540914.843255:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d68130bb80 x1875420968408960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540914.843276:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968408960:0@lo:13: 00000100:00100000:1.0:1788540914.843679:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409088 00000100:00100000:1.0:1788540914.843686:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409088 00000100:00100000:1.0:1788540914.843718:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788540914.843726:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1875420968409088:12345-0@lo:7: 00002000:00080000:1.0:1788540914.849751:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788540914.849761:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788540914.849901:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7937:x1875420968409088:12345-0@lo:7: Request processed in 6171us (8230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.849913:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788540914.851112:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d68130a300 x1875420968409088/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788540930 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540914.851130:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409088:0@lo:7: 00000004:00080000:0.0:1788540914.851145:0:7937:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788540914.851197:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409216:0@lo:5: 00000100:00100000:0.0:1788540914.851243:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.851290:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540914.851355:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409216 00000100:00100000:3.0:1788540914.851379:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409216 00000100:00100000:3.0:1788540914.851448:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540914.851458:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7937:x1875420968409216:12345-0@lo:5: 00002000:00080000:3.0:1788540914.851485:0:6706:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788540914.851489:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788540914.851821:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7937:x1875420968409216:12345-0@lo:5: Request processed in 364us (576us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788540914.851828:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788540914.851983:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d68130a300 x1875420968409216/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540930 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540914.851996:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409216:0@lo:5: 00000004:00080000:0.0:1788540914.852004:0:7937:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788540914.852030:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409344:0@lo:700: 00000100:00100000:0.0:1788540914.852096:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.852114:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.852127:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409344 00000100:00100000:0.0:1788540914.852131:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409344 00000100:00100000:0.0:1788540914.852164:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540914.852172:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7937:x1875420968409344:12345-0@lo:700: 00000100:00100000:0.0:1788540914.852199:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681309f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1875420968409472:0@lo:700: 00000100:00100000:0.0:1788540914.852241:0:6713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540914.852264:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540914.852431:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409472 00000100:00100000:0.0:1788540914.852435:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409472 00000100:00100000:0.0:1788540914.852470:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540914.852477:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1875420968409472:12345-0@lo:700: 40000000:02000000:1.0:1788540914.889293:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788540914.893843:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1875420968409472:12345-0@lo:700: Request processed in 41355us (41591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540914.893863:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788540914.894059:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d681309f80 x1875420968409472/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788540930 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540914.894076:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681309f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1875420968409472:0@lo:700: 40000000:02000000:3.0:1788540914.894088:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1788540914.985981:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788540914.986003:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788540914.986264:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7937:x1875420968409344:12345-0@lo:700: Request processed in 134079us (134154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540914.986277:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788540914.989722:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d681308380 x1875420968409344/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788540930 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540914.989737:0:7937:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788540914.989757:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409344:0@lo:700: 00000004:02000040:0.0:1788540915.065942:0:7937:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788540915.071191:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409600:0@lo:5: 00000100:00100000:3.0:1788540915.071276:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540915.071343:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519600 going to sleep for 11 seconds 00000100:00100000:0.0:1788540915.071673:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409600 00000100:00100000:0.0:1788540915.071680:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409600 00000100:00100000:0.0:1788540915.071718:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540915.071724:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7937:x1875420968409600:12345-0@lo:5: 00002000:00080000:0.0:1788540915.079887:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788540915.079907:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788540915.082223:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7937:x1875420968409600:12345-0@lo:5: Request processed in 10491us (10940us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788540915.082235:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788540915.082777:0:7937:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7ad256680 x1875420968409600/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540915.082796:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7937:1875420968409600:0@lo:5: 00000004:00080000:3.0:1788540915.082814:0:7937:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788540915.291565:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788540916.135543:0:8008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788540916.331284:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540917.340193:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540918.359623:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540918.745453:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540918.745487:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968409728:0@lo:13: 00000100:00100000:1.0:1788540918.745569:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540918.745695:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409728 00000100:00100000:2.0:1788540918.745704:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409728 00000100:00100000:2.0:1788540918.745774:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788540918.745786:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968409728:12345-0@lo:13: 00002000:00000024:2.0:1788540918.745821:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540918.745943:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968409728:12345-0@lo:13: Request processed in 159us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540918.745950:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788540918.746010:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca0700 x1875420968409728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540918.746028:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968409728:0@lo:13: 00000100:00080000:1.0:1788540918.747450:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788540919.384220:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540919.769692:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968409984:0@lo:400: 00000100:00100000:1.0:1788540919.769766:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540919.769814:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968410496:0@lo:400: 00000100:00100000:1.0:1788540919.769840:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540919.769872:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788540919.769878:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968409856:0@lo:400: 00000100:00100000:1.0:1788540919.769904:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540919.769925:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968410368:0@lo:400: 00000100:00100000:1.0:1788540919.769944:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540919.769971:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968410112:0@lo:400: 00000100:00100000:1.0:1788540919.770022:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540919.770041:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540919.770047:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968410240:0@lo:400: 00000100:00100000:1.0:1788540919.770089:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540919.770128:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409984 00000100:00100000:1.0:1788540919.770138:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409984 00000100:00100000:1.0:1788540919.770190:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410368 00000100:00100000:1.0:1788540919.770193:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410368 00000100:00100000:1.0:1788540919.770217:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410112 00000100:00100000:1.0:1788540919.770219:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410112 00000100:00100000:1.0:1788540919.770234:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540919.770242:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968409984:12345-0@lo:400: 00000100:00100000:1.0:1788540919.770296:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968409984:12345-0@lo:400: Request processed in 54us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540919.770304:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540919.770335:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788540919.770341:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968410368:12345-0@lo:400: 00000100:00100000:1.0:1788540919.770368:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968410368:12345-0@lo:400: Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540919.770374:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788540919.770385:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540919.770391:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968410112:12345-0@lo:400: 00000100:00100000:1.0:1788540919.770447:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968410112:12345-0@lo:400: Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540919.770453:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540919.770472:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410496 00000100:00100000:1.0:1788540919.770476:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410496 00000100:00100000:1.0:1788540919.770501:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410240 00000100:00100000:1.0:1788540919.770510:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410240 00000100:00100000:1.0:1788540919.770527:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540919.770532:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875420968410496:12345-0@lo:400: 00000100:00100000:1.0:1788540919.770562:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875420968410496:12345-0@lo:400: Request processed in 30us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540919.770568:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540919.770580:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540919.770586:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968410240:12345-0@lo:400: 00000100:00100000:1.0:1788540919.770611:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968410240:12345-0@lo:400: Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540919.770617:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788540919.770643:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788540919.770648:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788540919.770680:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904ca80 x1875420968410240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540919.770694:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968410240:0@lo:400: 00010000:00080000:1.0:1788540919.770706:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904f100 x1875420968410112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540919.770714:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968410112:0@lo:400: 00010000:00080000:1.0:1788540919.770745:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904c380 x1875420968410368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540919.770755:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968410368:0@lo:400: 00010000:00080000:1.0:1788540919.770766:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904ea00 x1875420968409984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540919.770773:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968409984:0@lo:400: 00010000:00080000:1.0:1788540919.770793:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904e300 x1875420968410496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540919.770802:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968410496:0@lo:400: 00000100:00100000:1.0:1788540919.770840:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968409856 00000100:00100000:1.0:1788540919.770844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968409856 00000100:00100000:1.0:1788540919.770869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788540919.770875:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968409856:12345-0@lo:400: 00000100:00100000:1.0:1788540919.770905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968409856:12345-0@lo:400: Request processed in 30us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540919.770911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788540919.770942:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968409856:0@lo:400: 00000100:00100000:1.0:1788540920.291155:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968410624:0@lo:13: 00000100:00100000:1.0:1788540920.291229:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540920.291620:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410624 00000100:00100000:2.0:1788540920.291630:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410624 00000100:00100000:2.0:1788540920.291686:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788540920.291697:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875420968410624:12345-0@lo:13: 00002000:00000024:2.0:1788540920.291735:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540920.291791:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875420968410624:12345-0@lo:13: Request processed in 95us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540920.291814:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788540920.293498:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7ad254e00 x1875420968410624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540920.293526:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968410624:0@lo:13: 00000001:00080000:2.0:1788540920.374879:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1788540920.412641:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540921.432184:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540922.167760:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540922.167900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318016 00000100:00100000:3.0:1788540922.167912:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318016 00000100:00100000:3.0:1788540922.167969:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:3.0:1788540922.167978:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1875420945318016:12345-192.168.202.59@tcp:250: 00010000:00080000:3.0:1788540922.168024:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 43ec13c5-96bd-48c4-8b44-93641d70bc35@192.168.202.59@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:3.0:1788540922.168055:0:5843:0:(genops.c:1385:class_connect()) connect: client 43ec13c5-96bd-48c4-8b44-93641d70bc35, cookie 0xc9a6a13d3cd1a9f4 00000100:00080000:3.0:1788540922.168207:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d681ffb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540922.168293:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+5:2357:x1875420945318016:12345-192.168.202.59@tcp:250: Request processed in 314us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540922.168312:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:3.0:1788540922.171862:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540922.180677:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318144 00000100:00100000:1.0:1788540922.180697:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318144 00000100:00100000:1.0:1788540922.181119:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:1.0:1788540922.181133:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+5:5586:x1875420945318144:12345-192.168.202.59@tcp:101: 00010000:00010000:1.0:1788540922.181155:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540922.181179:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac149a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540922.181209:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540922.181220:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540922.181251:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781679c00, rc 0) 00000100:00100000:1.0:1788540922.181335:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+6:5586:x1875420945318144:12345-192.168.202.59@tcp:101: Request processed in 205us (9484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540922.181344:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:1.0:1788540922.189774:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540922.190031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318272 00000100:00100000:3.0:1788540922.190045:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318272 00000100:00100000:3.0:1788540922.190108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:3.0:1788540922.190120:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+6:5586:x1875420945318272:12345-192.168.202.59@tcp:501: 00000100:00100000:3.0:1788540922.190435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+6:5586:x1875420945318272:12345-192.168.202.59@tcp:501: Request processed in 291us (658us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788540922.190443:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:1.0:1788540922.196572:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540922.196903:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318400 00000100:00100000:3.0:1788540922.196914:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318400 00000100:00100000:3.0:1788540922.196977:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:3.0:1788540922.196988:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+6:5586:x1875420945318400:12345-192.168.202.59@tcp:101: 00010000:00010000:3.0:1788540922.197008:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540922.197026:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac14a1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540922.197056:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540922.197069:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540922.197094:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bc200, rc 0) 00000100:00100000:3.0:1788540922.197150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+7:5586:x1875420945318400:12345-192.168.202.59@tcp:101: Request processed in 163us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540922.197156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:3.0:1788540922.198690:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540922.198833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318528 00000100:00100000:1.0:1788540922.198840:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318528 00000100:00100000:1.0:1788540922.198886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:1.0:1788540922.198896:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+7:5586:x1875420945318528:12345-192.168.202.59@tcp:501: 00000100:00100000:1.0:1788540922.199176:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5586:x1875420945318528:12345-192.168.202.59@tcp:501: Request processed in 280us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540922.199184:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:3.0:1788540922.204579:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540922.204716:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318656 00000100:00100000:1.0:1788540922.204727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318656 00000100:00100000:1.0:1788540922.204792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:1.0:1788540922.204804:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5586:x1875420945318656:12345-192.168.202.59@tcp:503: 00000100:00100000:1.0:1788540922.205199:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5586:x1875420945318656:12345-192.168.202.59@tcp:503: Request processed in 397us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540922.205209:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:1.0:1788540922.207479:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540922.207514:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318784 00000100:00100000:1.0:1788540922.207523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318784 00000100:00100000:1.0:1788540922.207570:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:1.0:1788540922.207580:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5605:x1875420945318784:12345-192.168.202.59@tcp:502: 00000100:00100000:1.0:1788540922.207933:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5605:x1875420945318784:12345-192.168.202.59@tcp:502: Request processed in 353us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540922.207941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:1.0:1788540922.240841:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540922.240990:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945318912 00000100:00100000:3.0:1788540922.241002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945318912 00000100:00100000:3.0:1788540922.241060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:3.0:1788540922.241071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5605:x1875420945318912:12345-192.168.202.59@tcp:502: 00000100:00100000:3.0:1788540922.241345:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5605:x1875420945318912:12345-192.168.202.59@tcp:502: Request processed in 274us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540922.241354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:1.0:1788540922.252243:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540922.252335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319040 00000100:00100000:2.0:1788540922.252349:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319040 00000100:00100000:2.0:1788540922.252429:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:2.0:1788540922.252441:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5586:x1875420945319040:12345-192.168.202.59@tcp:101: 00010000:00010000:2.0:1788540922.252472:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540922.252494:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fce00/0xc9a6a13d3cd1aa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac14cb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540922.252525:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fce00/0xc9a6a13d3cd1aa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14cb expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540922.252536:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fce00/0xc9a6a13d3cd1aa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14cb expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540922.252546:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fce00, rc 0) 00000100:00100000:2.0:1788540922.252601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5586:x1875420945319040:12345-192.168.202.59@tcp:101: Request processed in 163us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540922.252608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:2.0:1788540922.260542:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540922.260847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319168 00000100:00100000:0.0:1788540922.260858:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319168 00000100:00100000:0.0:1788540922.260919:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:0.0:1788540922.260930:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5586:x1875420945319168:12345-192.168.202.59@tcp:256: 20000000:01000000:0.0:1788540922.261064:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788540922.261087:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788540922.261091:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788540922.261094:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788540922.261097:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788540922.271765:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5586:x1875420945319168:12345-192.168.202.59@tcp:256: Request processed in 10817us (11212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540922.271794:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:0.0:1788540922.274579:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540922.274658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319296 00000100:00100000:3.0:1788540922.274669:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319296 00000100:00100000:3.0:1788540922.274725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:3.0:1788540922.274736:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5586:x1875420945319296:12345-192.168.202.59@tcp:101: 00010000:00010000:3.0:1788540922.274813:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540922.274833:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac14d2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540922.274863:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540922.274875:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540922.274901:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bdc00, rc 0) 00000100:00100000:3.0:1788540922.275017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5586:x1875420945319296:12345-192.168.202.59@tcp:101: Request processed in 215us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540922.275026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:3.0:1788540922.278065:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540922.278154:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319424 00000100:00100000:0.0:1788540922.278164:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319424 00000100:00100000:0.0:1788540922.278220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:0.0:1788540922.278232:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5586:x1875420945319424:12345-192.168.202.59@tcp:501: 00000100:00100000:0.0:1788540922.278556:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5586:x1875420945319424:12345-192.168.202.59@tcp:501: Request processed in 326us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540922.278571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:0.0:1788540922.285366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540922.285437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319552 00000100:00100000:2.0:1788540922.285447:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319552 00000100:00100000:2.0:1788540922.285508:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:2.0:1788540922.285517:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5586:x1875420945319552:12345-192.168.202.59@tcp:503: 00000100:00100000:2.0:1788540922.285946:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5586:x1875420945319552:12345-192.168.202.59@tcp:503: Request processed in 428us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540922.285955:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:1.0:1788540922.290002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540922.290087:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319680 00000100:00100000:3.0:1788540922.290098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319680 00000100:00100000:3.0:1788540922.290157:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:3.0:1788540922.290170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5607:x1875420945319680:12345-192.168.202.59@tcp:502: 00000100:00100000:3.0:1788540922.290719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5607:x1875420945319680:12345-192.168.202.59@tcp:502: Request processed in 549us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540922.290729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:0.0:1788540922.299133:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540922.299216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319808 00000100:00100000:1.0:1788540922.299227:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319808 00000100:00100000:1.0:1788540922.299280:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:1.0:1788540922.299291:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5607:x1875420945319808:12345-192.168.202.59@tcp:502: 00000100:00100000:1.0:1788540922.299608:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5607:x1875420945319808:12345-192.168.202.59@tcp:502: Request processed in 318us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540922.299617:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:3.0:1788540922.306065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540922.306470:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945319936 00000100:00100000:0.0:1788540922.306481:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945319936 00000100:00100000:0.0:1788540922.306533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1788540922.306544:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875420945319936:12345-192.168.202.59@tcp:38: 00010000:00080000:0.0:1788540922.306576:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:0.0:1788540922.306630:0:5852:0:(genops.c:1385:class_connect()) connect: client 103c367e-0a85-454e-8289-79a7b521f7f2, cookie 0xc9a6a13d3cd1aa17 00000004:00100000:0.0:1788540922.306663:0:5852:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788540922.306670:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788540922.337382:0:5852:0:(import.c:65:import_set_state_nolock()) ffff98d7ae097000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540922.337500:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2357:x1875420945319936:12345-192.168.202.59@tcp:38: Request processed in 30956us (31443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540922.337510:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00010000:00010000:2.0:1788540922.455867:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540923.342201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540923.342245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540923.342346:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320064 00000100:00100000:1.0:1788540923.342356:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320064 00000100:00100000:1.0:1788540923.342468:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320192 00000100:00100000:1.0:1788540923.342472:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320192 00000100:00100000:1.0:1788540923.342492:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1788540923.342501:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:0:x1875420945320064:12345-192.168.202.59@tcp:41: 00000004:00000024:1.0:1788540923.342548:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788540923.342670:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:0:x1875420945320064:12345-192.168.202.59@tcp:41: Request processed in 169us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540923.342678:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1788540923.342696:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1788540923.342704:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:5586:x1875420945320192:12345-192.168.202.59@tcp:41: 00000004:00000024:1.0:1788540923.342716:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788540923.342754:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:5586:x1875420945320192:12345-192.168.202.59@tcp:41: Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540923.342760:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00080000:0.0:1788540923.343244:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540923.350704:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540923.350795:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320320 00000100:00100000:3.0:1788540923.350807:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320320 00000100:00100000:3.0:1788540923.350869:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1788540923.350880:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:5586:x1875420945320320:12345-192.168.202.59@tcp:40: 00000100:00100000:3.0:1788540923.350980:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:5586:x1875420945320320:12345-192.168.202.59@tcp:40: Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540923.350987:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1788540923.353643:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540923.353686:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540923.353716:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540923.353921:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320448 00000100:00100000:2.0:1788540923.353931:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320448 00000100:00100000:2.0:1788540923.353973:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320576 00000100:00100000:2.0:1788540923.353976:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320576 00000100:00100000:2.0:1788540923.353991:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788540923.354000:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875420945320448:12345-192.168.202.59@tcp:8: 00010000:00080000:2.0:1788540923.354034:0:6706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788540923.354082:0:6706:0:(genops.c:1385:class_connect()) connect: client 103c367e-0a85-454e-8289-79a7b521f7f2, cookie 0xc9a6a13d3cd1aa1e 00002000:00100000:2.0:1788540923.354096:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 103c367e-0a85-454e-8289-79a7b521f7f2/ffff98d7b5261800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788540923.354122:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788540923.354560:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788540923.354594:0:6706:0:(import.c:65:import_set_state_nolock()) ffff98d7b5266800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540923.354664:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2357:x1875420945320448:12345-192.168.202.59@tcp:8: Request processed in 663us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540923.354672:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788540923.354693:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:2.0:1788540923.354717:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875420945320576:12345-192.168.202.59@tcp:8: 00010000:00080000:2.0:1788540923.354734:0:6706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788540923.354750:0:6706:0:(genops.c:1385:class_connect()) connect: client 103c367e-0a85-454e-8289-79a7b521f7f2, cookie 0xc9a6a13d3cd1aa25 00002000:00100000:2.0:1788540923.354756:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 103c367e-0a85-454e-8289-79a7b521f7f2/ffff98d7b5262000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788540923.354771:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788540923.354987:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788540923.355003:0:6706:0:(import.c:65:import_set_state_nolock()) ffff98d7b5261000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540923.355032:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2357:x1875420945320576:12345-192.168.202.59@tcp:8: Request processed in 315us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540923.355039:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1788540923.355860:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320704 00000100:00100000:0.0:1788540923.355871:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320704 00000100:00100000:0.0:1788540923.355932:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1788540923.355942:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:5586:x1875420945320704:12345-192.168.202.59@tcp:33: 00000100:00100000:1.0:1788540923.370234:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540923.370325:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320832 00000100:00100000:2.0:1788540923.370337:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320832 00000100:00100000:2.0:1788540923.370403:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:2.0:1788540923.370440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2359:x1875420945320832:12345-192.168.202.59@tcp:400: 00000100:00100000:2.0:1788540923.370514:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2359:x1875420945320832:12345-192.168.202.59@tcp:400: Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540923.370522:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 128 00000004:00080000:3.0:1788540923.388583:0:5853:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32566us 00000004:00200000:0.0:1788540923.413517:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788540923.413667:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:5586:x1875420945320704:12345-192.168.202.59@tcp:33: Request processed in 57717us (60023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540923.413696:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00010000:00010000:0.0:1788540923.479790:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540923.563970:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540923.565344:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945320960 00000100:00100000:0.0:1788540923.565362:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945320960 00000100:00100000:0.0:1788540923.565474:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1788540923.565486:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:5624:x1875420945320960:12345-192.168.202.59@tcp:101: 00010000:00010000:0.0:1788540923.565509:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540923.565574:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1aa2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac14fc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540923.565645:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1aa33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540923.565659:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1aa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540923.565677:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1aa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788540923.565711:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788540923.565715:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788540923.565731:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1aa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540923.565756:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1aa2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14fc expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540923.565779:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1aa33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14fc expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540923.565808:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22b900) 00010000:00010000:0.0:1788540923.565812:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788540923.565816:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:0.0:1788540923.565901:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:5624:x1875420945320960:12345-192.168.202.59@tcp:101: Request processed in 417us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540923.565908:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1788540923.864201:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788540923.864246:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968410752:0@lo:13: 00000100:00100000:3.0:1788540923.864352:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540923.864798:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410752 00000100:00100000:2.0:1788540923.864806:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410752 00000100:00100000:2.0:1788540923.864872:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788540923.864882:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968410752:12345-0@lo:13: 00002000:00000024:2.0:1788540923.864908:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540923.864954:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968410752:12345-0@lo:13: Request processed in 73us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540923.864960:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788540923.865092:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788540923.865123:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca0700 x1875420968410752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540923.865148:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968410752:0@lo:13: 00000001:00100000:2.0:1788540923.923819:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00010000:00010000:2.0:1788540924.503734:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540924.887822:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968411264:0@lo:400: 00000100:00100000:2.0:1788540924.887882:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540924.887931:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788540924.887935:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968411136:0@lo:400: 00000100:00100000:2.0:1788540924.887952:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540924.887975:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411264 00000100:00100000:2.0:1788540924.887980:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411264 00000100:00100000:2.0:1788540924.888015:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540924.888021:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968411264:12345-0@lo:400: 00000100:00100000:2.0:1788540924.888056:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968411264:12345-0@lo:400: Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540924.888061:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788540924.888090:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca1f80 x1875420968411264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540924.888101:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968411264:0@lo:400: 00000100:00100000:1.0:1788540924.888170:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968411008:0@lo:400: 00000100:00100000:1.0:1788540924.888199:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540924.888219:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968411520:0@lo:400: 00000100:00100000:1.0:1788540924.888233:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540924.888243:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788540924.888246:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968410880:0@lo:400: 00000100:00100000:1.0:1788540924.888261:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540924.888299:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968411392:0@lo:400: 00000100:00100000:1.0:1788540924.888314:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540924.888333:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411136 00000100:00100000:1.0:1788540924.888335:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411136 00000100:00100000:1.0:1788540924.888357:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411008 00000100:00100000:1.0:1788540924.888358:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411008 00000100:00100000:1.0:1788540924.888378:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411392 00000100:00100000:1.0:1788540924.888381:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411392 00000100:00100000:1.0:1788540924.888395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788540924.888401:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968411136:12345-0@lo:400: 00000100:00100000:1.0:1788540924.888458:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968411136:12345-0@lo:400: Request processed in 57us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540924.888462:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788540924.888471:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788540924.888475:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968411008:12345-0@lo:400: 00000100:00100000:1.0:1788540924.888533:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968411008:12345-0@lo:400: Request processed in 57us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540924.888540:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788540924.888551:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788540924.888556:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968411392:12345-0@lo:400: 00000100:00100000:1.0:1788540924.888591:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968411392:12345-0@lo:400: Request processed in 35us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540924.888597:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788540924.888623:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968411392:0@lo:400: 00000100:00100000:1.0:1788540924.888634:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968411008:0@lo:400: 00000100:00100000:2.0:1788540924.888880:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968411136:0@lo:400: 00000100:00100000:3.0:1788540924.888965:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411520 00000100:00100000:3.0:1788540924.888971:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411520 00000100:00100000:3.0:1788540924.889007:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540924.889015:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968411520:12345-0@lo:400: 00000100:00100000:3.0:1788540924.889060:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968411520:12345-0@lo:400: Request processed in 46us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540924.889066:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540924.889084:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968410880 00000100:00100000:3.0:1788540924.889087:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968410880 00000100:00100000:3.0:1788540924.889110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788540924.889116:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968410880:12345-0@lo:400: 00000100:00100000:3.0:1788540924.889145:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968410880:12345-0@lo:400: Request processed in 29us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540924.889150:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1788540924.889176:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788540924.889180:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788540924.889241:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968410880:0@lo:400: 00010000:00080000:1.0:1788540924.889254:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca2d80 x1875420968411520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540924.889263:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788540924.889283:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968411520:0@lo:400: 00000100:00100000:0.0:1788540925.409892:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788540925.409922:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968411648:0@lo:13: 00000100:00100000:0.0:1788540925.409995:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540925.412688:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411648 00000100:00100000:2.0:1788540925.412706:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411648 00000100:00100000:2.0:1788540925.412792:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788540925.412804:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968411648:12345-0@lo:13: 00002000:00000024:2.0:1788540925.412845:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540925.412943:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968411648:12345-0@lo:13: Request processed in 141us (2947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540925.412950:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788540925.417450:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca3b80 x1875420968411648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540925.417483:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968411648:0@lo:13: 00010000:00010000:0.0:1788540925.528046:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540925.632576:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540925.632701:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321088 00000100:00100000:1.0:1788540925.632711:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321088 00000100:00100000:1.0:1788540925.632791:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1788540925.632802:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:5676:x1875420945321088:12345-192.168.202.59@tcp:41: 00000004:00000024:1.0:1788540925.632852:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788540925.632945:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:5676:x1875420945321088:12345-192.168.202.59@tcp:41: Request processed in 145us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540925.632953:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00080000:3.0:1788540925.633025:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788540925.639752:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540925.639907:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321216 00000100:00100000:2.0:1788540925.639920:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321216 00000100:00100000:2.0:1788540925.640011:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1788540925.640023:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:103c367e-0a85-454e-8289-79a7b521f7f2+5:5676:x1875420945321216:12345-192.168.202.59@tcp:13: 00002000:00000024:2.0:1788540925.640071:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540925.640159:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:103c367e-0a85-454e-8289-79a7b521f7f2+5:5676:x1875420945321216:12345-192.168.202.59@tcp:13: Request processed in 138us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540925.640167:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00080000:3.0:1788540925.640823:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788540925.644518:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540925.646593:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321344 00000100:00100000:2.0:1788540925.646610:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321344 00000100:00100000:2.0:1788540925.646716:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1788540925.646729:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:103c367e-0a85-454e-8289-79a7b521f7f2+6:5676:x1875420945321344:12345-192.168.202.59@tcp:13: 00002000:00000024:2.0:1788540925.646764:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540925.646846:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:103c367e-0a85-454e-8289-79a7b521f7f2+6:5676:x1875420945321344:12345-192.168.202.59@tcp:13: Request processed in 120us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540925.646854:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00080000:3.0:1788540925.646946:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788540926.551823:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788540927.532038:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000001:00100000:2.0:1788540927.532069:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00010000:00010000:0.0:1788540927.575680:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788540928.055149:0:8313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788540928.599699:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540928.635185:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540928.635249:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540928.635283:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540928.635310:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540928.635346:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321728 00000100:00100000:1.0:1788540928.635356:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321728 00000100:00100000:1.0:1788540928.635457:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321856 00000100:00100000:1.0:1788540928.635460:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321856 00000100:00100000:1.0:1788540928.635482:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1788540928.635491:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945321728:12345-192.168.202.59@tcp:400: 00000100:00100000:1.0:1788540928.635564:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945321728:12345-192.168.202.59@tcp:400: Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540928.635571:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1788540928.635586:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:1.0:1788540928.635593:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945321856:12345-192.168.202.59@tcp:400: 00000100:00100000:1.0:1788540928.635617:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945321856:12345-192.168.202.59@tcp:400: Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540928.635624:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1788540928.636047:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321472 00000100:00100000:0.0:1788540928.636053:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321472 00000100:00100000:0.0:1788540928.636094:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:0.0:1788540928.636102:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945321472:12345-192.168.202.59@tcp:400: 00000100:00100000:0.0:1788540928.636133:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945321472:12345-192.168.202.59@tcp:400: Request processed in 33us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540928.636139:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:3.0:1788540928.636285:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321600 00000100:00100000:3.0:1788540928.636291:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321600 00000100:00100000:3.0:1788540928.636344:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1788540928.636353:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945321600:12345-192.168.202.59@tcp:400: 00000100:00100000:3.0:1788540928.636384:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945321600:12345-192.168.202.59@tcp:400: Request processed in 34us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540928.636391:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00080000:3.0:1788540928.636438:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788540928.636443:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788540928.636446:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788540928.988997:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540928.989025:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968411776:0@lo:13: 00000100:00100000:2.0:1788540928.989101:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540928.989165:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411776 00000100:00100000:2.0:1788540928.989172:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411776 00000100:00100000:2.0:1788540928.989230:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788540928.989258:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968411776:12345-0@lo:13: 00002000:00000024:2.0:1788540928.989303:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540928.989350:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968411776:12345-0@lo:13: Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540928.989356:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788540928.989388:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788540928.989464:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca1f80 x1875420968411776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540928.989483:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968411776:0@lo:13: 00010000:00010000:0.0:1788540929.626586:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540930.009531:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968412160:0@lo:400: 00000100:00100000:1.0:1788540930.009589:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540930.009644:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540930.009651:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968412288:0@lo:400: 00000100:00100000:1.0:1788540930.009686:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540930.009724:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968412160 00000100:00100000:1.0:1788540930.009731:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968412160 00000100:00100000:1.0:1788540930.009784:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788540930.009794:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968412160:12345-0@lo:400: 00000100:00100000:1.0:1788540930.009835:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968412160:12345-0@lo:400: Request processed in 44us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540930.009840:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788540930.009858:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968412288 00000100:00100000:1.0:1788540930.009860:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968412288 00000100:00100000:0.0:1788540930.009982:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968412032:0@lo:400: 00000100:00100000:0.0:1788540930.010013:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540930.010032:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968412544:0@lo:400: 00000100:00100000:0.0:1788540930.010051:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540930.010064:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788540930.010073:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968411904:0@lo:400: 00000100:00100000:0.0:1788540930.010093:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540930.010105:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968412416:0@lo:400: 00000100:00100000:0.0:1788540930.010117:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540930.010134:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968412032 00000100:00100000:0.0:1788540930.010136:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968412032 00000100:00100000:0.0:1788540930.010151:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968412416 00000100:00100000:0.0:1788540930.010153:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968412416 00000100:00100000:0.0:1788540930.010161:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540930.010165:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968412032:12345-0@lo:400: 00000100:00100000:0.0:1788540930.010188:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968412032:12345-0@lo:400: Request processed in 22us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540930.010192:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540930.010199:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540930.010203:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968412416:12345-0@lo:400: 00000100:00100000:0.0:1788540930.010217:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968412416:12345-0@lo:400: Request processed in 14us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540930.010220:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788540930.010270:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968412544 00000100:00100000:0.0:1788540930.010272:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968412416:0@lo:400: 00000100:00100000:1.0:1788540930.010273:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968412544 00000100:00100000:0.0:1788540930.010283:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968412032:0@lo:400: 00000100:00100000:1.0:1788540930.010297:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788540930.010304:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968412288:12345-0@lo:400: 00000100:00100000:1.0:1788540930.010336:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968412288:12345-0@lo:400: Request processed in 33us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540930.010343:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788540930.010355:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788540930.010360:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968412544:12345-0@lo:400: 00000100:00100000:3.0:1788540930.010382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968411904 00000100:00100000:3.0:1788540930.010387:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968411904 00000100:00100000:1.0:1788540930.010397:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968412544:12345-0@lo:400: Request processed in 37us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540930.010403:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788540930.010431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788540930.010438:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968411904:12345-0@lo:400: 00000100:00080000:1.0:1788540930.010443:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788540930.010447:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788540930.010449:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540930.010471:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968411904:12345-0@lo:400: Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540930.010477:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:1.0:1788540930.010479:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78386ed80 x1875420968412288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540930.010490:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968412288:0@lo:400: 00000100:00100000:1.0:1788540930.010510:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968412160:0@lo:400: 00000100:00100000:0.0:1788540930.010700:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968411904:0@lo:400: 00010000:00080000:0.0:1788540930.010712:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78386c380 x1875420968412544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540930.010721:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968412544:0@lo:400: 00000100:00100000:3.0:1788540930.519901:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788540930.519930:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968412672:0@lo:13: 00000100:00100000:3.0:1788540930.520003:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540930.520122:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968412672 00000100:00100000:2.0:1788540930.520132:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968412672 00000100:00100000:2.0:1788540930.520185:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788540930.520196:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968412672:12345-0@lo:13: 00002000:00000024:2.0:1788540930.520252:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540930.520305:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968412672:12345-0@lo:13: Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540930.520313:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788540930.520483:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca1f80 x1875420968412672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540930.520503:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968412672:0@lo:13: 00010000:00010000:2.0:1788540930.649572:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788540931.335122:0:8461:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed3a33c20 20000000:00000080:1.0:1788540931.335209:0:8461:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d7bf66f800 uarg=0000000000000000 20000000:01000000:1.0:1788540931.335257:0:8461:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788540931.335259:0:8461:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788540931.335261:0:8461:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788540931.335265:0:8461:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788540931.335269:0:8461:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788540931.335281:0:8461:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788540931.335284:0:8461:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788540931.335660:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788540931.335664:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788540931.336670:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788540931.337115:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788540931.337256:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788540931.337290:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788540931.337303:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788540931.337305:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788540931.338187:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788540931.338581:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788540931.338642:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788540931.338670:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788540931.338680:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788540931.338681:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788540931.339289:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788540931.339650:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788540931.339705:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788540931.339755:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788540931.339768:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788540931.339771:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788540931.340728:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788540931.341031:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788540931.341066:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788540931.341085:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788540931.341098:0:8461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788540931.341115:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341129:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341222:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341227:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341231:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341235:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341239:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341243:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341249:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341253:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341263:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341296:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341306:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 9 pid: 5843 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.341318:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb477480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968412800:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788540931.341545:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341554:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.341562:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968412928:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788540931.341594:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341602:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 18 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.341612:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb474a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413056:0@lo:104: 00000100:00100000:3.0:1788540931.341650:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540931.341962:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.341982:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 18 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.341991:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413184:0@lo:104: 00000100:00100000:3.0:1788540931.342020:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540931.342316:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.342325:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 18 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.342333:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413312:0@lo:104: 00010000:00010000:3.0:1788540931.342358:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.342366:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 18 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.345508:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb474380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413440:0@lo:104: 00010000:00010000:3.0:1788540931.345598:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.345610:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 18 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.345619:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413568:0@lo:104: 00010000:00010000:3.0:1788540931.345647:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.345670:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 18 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.345678:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413696:0@lo:104: 00010000:00010000:3.0:1788540931.345706:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.345713:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 18 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.345719:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413824:0@lo:104: 00000100:00100000:3.0:1788540931.345735:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540931.345861:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540931.346156:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb477480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968412800:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788540931.346166:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968412928:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788540931.346296:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413056 00000100:00100000:1.0:1788540931.346304:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413056 00000100:00100000:1.0:1788540931.346346:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413184 00000100:00100000:1.0:1788540931.346349:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413184 00000100:00100000:1.0:1788540931.346364:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540931.346372:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:8461:x1875420968413056:12345-0@lo:104: 00010000:00010000:1.0:1788540931.346396:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.346530:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788540931.346536:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:8461:x1875420968413056:12345-0@lo:104: Request processed in 165us (4886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.346555:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540931.346574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540931.346581:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8461:x1875420968413184:12345-0@lo:104: 00010000:00010000:1.0:1788540931.346589:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.346737:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb474a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413056:0@lo:104: 00000100:00100000:3.0:1788540931.346745:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413184:0@lo:104: 00000100:00100000:0.0:1788540931.346876:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945321984 00000100:00100000:0.0:1788540931.346881:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945321984 00010000:00010000:0.0:1788540931.346904:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 10 pid: 5843 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540931.346967:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1788540931.346976:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2359:x1875420945321984:12345-192.168.202.59@tcp:103: 00010000:00010000:0.0:1788540931.346986:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540931.346993:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 10 pid: 5843 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.347005:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 10 pid: 5843 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.347023:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bc200/0xc9a6a13d3cd1aa02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14a1 expref: 10 pid: 5843 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.347038:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540931.347081:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:2359:x1875420945321984:12345-192.168.202.59@tcp:103: Request processed in 107us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.347087:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:2.0:1788540931.347117:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788540931.347124:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347130:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:2.0:1788540931.347144:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347153:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540931.347169:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540931.347175:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540931.347204:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347209:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540931.347236:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347243:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031a00/0xc9a6a13d3cd1a9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9ed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347254:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540931.347256:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347261:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bde00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:2.0:1788540931.347263:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347269:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540931.347275:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540931.347281:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540931.347301:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347307:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540931.347320:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347326:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bde00/0xc9a6a13d3cd1a9bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.347335:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540931.347336:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540931.347338:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540931.347523:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968413952:0@lo:103: 00000100:00100000:2.0:1788540931.347559:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788540931.347702:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788540931.347710:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8461:x1875420968413184:12345-0@lo:104: Request processed in 1130us (5688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.347716:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540931.347768:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.347785:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.347793:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.347801:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.347810:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.347820:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413312 00000100:00100000:1.0:1788540931.347824:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413312 00000100:00100000:1.0:1788540931.347840:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413440 00000100:00100000:1.0:1788540931.347843:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413440 00000100:00100000:1.0:1788540931.347851:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413568 00000100:00100000:1.0:1788540931.347853:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413568 00000100:00100000:1.0:1788540931.347861:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413696 00000100:00100000:1.0:1788540931.347863:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413696 00000100:00100000:1.0:1788540931.347870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413824 00000100:00100000:1.0:1788540931.347873:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413824 00000100:00100000:1.0:1788540931.347883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540931.347889:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+7:8461:x1875420968413312:12345-0@lo:104: 00010000:00010000:1.0:1788540931.347898:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.347950:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788540931.347956:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+7:8461:x1875420968413312:12345-0@lo:104: Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.347962:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540931.347974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540931.347980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:8461:x1875420968413440:12345-0@lo:104: 00010000:00010000:1.0:1788540931.347987:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348013:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788540931.348018:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+6:8461:x1875420968413440:12345-0@lo:104: Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.348023:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540931.348034:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540931.348038:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:8461:x1875420968413568:12345-0@lo:104: 00010000:00010000:1.0:1788540931.348045:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348069:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788540931.348074:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:8461:x1875420968413568:12345-0@lo:104: Request processed in 36us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.348080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540931.348090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788540931.348096:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:8461:x1875420968413696:12345-0@lo:104: 00010000:00010000:1.0:1788540931.348102:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348157:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788540931.348162:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:8461:x1875420968413696:12345-0@lo:104: Request processed in 67us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.348168:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788540931.348179:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540931.348184:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8461:x1875420968413824:12345-0@lo:104: 00010000:00010000:1.0:1788540931.348191:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348226:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788540931.348230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8461:x1875420968413824:12345-0@lo:104: Request processed in 47us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.348236:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788540931.348258:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788540931.348263:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348269:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540931.348273:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348280:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540931.348289:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.348294:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540931.348325:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348332:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540931.348340:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348345:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bd000/0xc9a6a13d3cd1a9a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a9a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348355:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788540931.348358:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348363:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd400 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540931.348365:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348371:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540931.348386:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.348391:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540931.348403:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348430:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540931.348444:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348460:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1a992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a999 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348469:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788540931.348472:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348477:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bcc00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540931.348480:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348486:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540931.348492:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.348496:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540931.348510:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348515:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540931.348520:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348525:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bcc00/0xc9a6a13d3cd1a984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a98b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348533:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788540931.348542:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348548:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540931.348551:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348557:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540931.348562:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.348567:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540931.348579:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348585:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540931.348589:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348595:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1a95a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a961 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348604:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540931.348606:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348612:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781679e00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788540931.348615:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348630:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540931.348636:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.348641:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540931.348654:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348659:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540931.348662:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348668:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d781679e00/0xc9a6a13d3cd1a930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a937 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.348680:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540931.348682:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540931.348683:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540931.348694:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968414336:0@lo:103: 00010000:00010000:1.0:1788540931.348732:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540931.348956:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968414464:0@lo:103: 00000100:00100000:2.0:1788540931.348982:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.349102:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968413952 00000100:00100000:3.0:1788540931.349108:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968413952 00000100:00100000:1.0:1788540931.349576:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:3.0:1788540931.350100:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 19 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.350144:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788540931.350155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968413952:12345-0@lo:103: 00010000:00010000:3.0:1788540931.350167:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540931.350173:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 19 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.350196:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 19 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.350209:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1a9ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9df expref: 19 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.350235:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540931.350278:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3317:x1875420968413952:12345-0@lo:103: Request processed in 127us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.350285:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788540931.350317:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968414080:0@lo:103: 00000100:00100000:3.0:1788540931.350649:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413312:0@lo:104: 00000100:00100000:0.0:1788540931.350818:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968414208:0@lo:103: 00000100:00100000:3.0:1788540931.351000:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb474380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413440:0@lo:104: 00000100:00100000:3.0:1788540931.351010:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413568:0@lo:104: 00000100:00100000:3.0:1788540931.351017:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413696:0@lo:104: 00000100:00100000:3.0:1788540931.351023:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1875420968413824:0@lo:104: 00010000:00010000:3.0:1788540931.351057:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.351219:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.351245:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414464 00000100:00100000:3.0:1788540931.351251:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414464 00010000:00010000:3.0:1788540931.351271:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 18 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.351289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414080 00000100:00100000:3.0:1788540931.351292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414080 00010000:00010000:3.0:1788540931.351312:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 19 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.351326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788540931.351333:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968414464:12345-0@lo:103: 00010000:00010000:3.0:1788540931.351343:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540931.351347:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 19 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351355:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 19 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351368:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1a98b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a984 expref: 19 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351391:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540931.351449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3317:x1875420968414464:12345-0@lo:103: Request processed in 116us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.351455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788540931.351468:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540931.351473:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968414080:12345-0@lo:103: 00010000:00010000:3.0:1788540931.351480:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540931.351484:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 17 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351492:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 17 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351501:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fdc00/0xc9a6a13d3cd1a9c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9bc expref: 17 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351519:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540931.351546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3314:x1875420968414080:12345-0@lo:103: Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.351552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540931.351574:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540931.351591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322112 00000100:00100000:3.0:1788540931.351594:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322112 00010000:00010000:3.0:1788540931.351607:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.351620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1788540931.351625:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:2359:x1875420945322112:12345-192.168.202.59@tcp:103: 00010000:00010000:3.0:1788540931.351632:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540931.351635:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351645:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351655:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781679c00/0xc9a6a13d3cd1a9fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac149a expref: 9 pid: 5844 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.351663:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540931.351696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:2359:x1875420945322112:12345-192.168.202.59@tcp:103: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.351702:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1788540931.352192:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968414464:0@lo:103: 00000100:00100000:2.0:1788540931.352204:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968413952:0@lo:103: 00000100:00100000:3.0:1788540931.352350:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968414080:0@lo:103: 00000100:00100000:3.0:1788540931.352367:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968414592:0@lo:103: 00000100:00100000:3.0:1788540931.352439:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.352564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414592 00000100:00100000:2.0:1788540931.352569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414592 00010000:00010000:2.0:1788540931.352590:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 16 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540931.352606:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540931.352612:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3314:x1875420968414592:12345-0@lo:103: 00010000:00010000:2.0:1788540931.352620:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540931.352624:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 16 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.352639:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 16 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.352652:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bc400/0xc9a6a13d3cd1a961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a95a expref: 16 pid: 5844 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.352664:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540931.352702:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3314:x1875420968414592:12345-0@lo:103: Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540931.352708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788540931.352768:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968414592:0@lo:103: 00000100:00100000:1.0:1788540931.352850:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540931.353045:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540931.353066:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968414720:0@lo:103: 00000100:00100000:0.0:1788540931.353097:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540931.353124:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414336 00000100:00100000:0.0:1788540931.353128:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414336 00010000:00010000:0.0:1788540931.353158:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 15 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540931.353170:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414208 00000100:00100000:0.0:1788540931.353172:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414208 00010000:00010000:0.0:1788540931.353181:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 16 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540931.353190:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414720 00000100:00100000:0.0:1788540931.353193:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414720 00010000:00010000:0.0:1788540931.353202:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 17 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540931.353224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788540931.353230:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78316d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3316:x1875420968414336:12345-0@lo:103: 00010000:00010000:0.0:1788540931.353239:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540931.353243:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 17 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353251:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 17 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353261:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1a999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a992 expref: 17 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353272:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540931.353302:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78316d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3316:x1875420968414336:12345-0@lo:103: Request processed in 73us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.353317:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788540931.353353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788540931.353359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3315:x1875420968414208:12345-0@lo:103: 00010000:00010000:0.0:1788540931.353366:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540931.353370:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 15 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353587:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 15 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353599:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1a9a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a9a0 expref: 15 pid: 5842 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353608:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540931.353645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:3315:x1875420968414208:12345-0@lo:103: Request processed in 287us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.353651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788540931.353664:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788540931.353670:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:3315:x1875420968414720:12345-0@lo:103: 00010000:00010000:0.0:1788540931.353678:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540931.353683:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353692:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353701:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fd000/0xc9a6a13d3cd1a937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a930 expref: 13 pid: 5843 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353725:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353733:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353748:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353755:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353761:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353768:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353774:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bda00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788540931.353778:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353786:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353797:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.353807:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540931.353830:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:3315:x1875420968414720:12345-0@lo:103: Request processed in 161us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.353846:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540931.353972:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968414208:0@lo:103: 00000100:00100000:3.0:1788540931.353981:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968414720:0@lo:103: 00010000:00010000:3.0:1788540931.354007:0:8461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.354015:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.354021:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540931.355254:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968414336:0@lo:103: 00010000:00010000:1.0:1788540931.672048:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540932.412064:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540932.412197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322240 00000100:00100000:3.0:1788540932.412217:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322240 00000100:00100000:3.0:1788540932.412282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:3.0:1788540932.412292:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:5600:x1875420945322240:12345-192.168.202.59@tcp:101: 00010000:00010000:3.0:1788540932.412310:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540932.412329:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bc800/0xc9a6a13d3cd1aa41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1503 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.412355:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bc800/0xc9a6a13d3cd1aa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1503 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.412367:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bc800/0xc9a6a13d3cd1aa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1503 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.412396:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bc800, rc 0) 00000100:00100000:3.0:1788540932.412483:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945322240:12345-192.168.202.59@tcp:101: Request processed in 191us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.412501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:3.0:1788540932.414803:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540932.414910:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322368 00000100:00100000:0.0:1788540932.414920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322368 00000100:00100000:0.0:1788540932.414974:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:0.0:1788540932.414984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945322368:12345-192.168.202.59@tcp:501: 00000100:00100000:0.0:1788540932.415296:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945322368:12345-192.168.202.59@tcp:501: Request processed in 313us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.415304:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:1.0:1788540932.419041:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540932.420580:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322496 00000100:00100000:3.0:1788540932.420595:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322496 00000100:00100000:3.0:1788540932.420687:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00100000:3.0:1788540932.420697:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945322496:12345-192.168.202.59@tcp:503: 00000100:00100000:3.0:1788540932.420945:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945322496:12345-192.168.202.59@tcp:503: Request processed in 248us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.420953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00100000:1.0:1788540932.435644:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540932.435820:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322624 00000100:00100000:3.0:1788540932.435831:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322624 00000100:00100000:3.0:1788540932.435897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 135 00000100:00100000:3.0:1788540932.435908:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:6064:x1875420945322624:12345-192.168.202.59@tcp:502: 00000100:00100000:3.0:1788540932.436178:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:6064:x1875420945322624:12345-192.168.202.59@tcp:502: Request processed in 270us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.436186:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 135 00000100:00100000:2.0:1788540932.438918:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540932.439020:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322752 00000100:00100000:0.0:1788540932.439030:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322752 00000100:00100000:0.0:1788540932.439083:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 136 00000100:00100000:0.0:1788540932.439093:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:6064:x1875420945322752:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788540932.439387:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:6064:x1875420945322752:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 295us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.439395:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 136 00000100:00100000:1.0:1788540932.444308:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540932.444448:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945322880 00000100:00100000:3.0:1788540932.444458:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945322880 00000100:00100000:3.0:1788540932.444503:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00100000:3.0:1788540932.444514:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945322880:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540932.444529:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540932.444555:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac150a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.444582:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac150a expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.444595:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac150a expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.444605:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bda00, rc 0) 00000100:00100000:3.0:1788540932.444683:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945322880:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 171us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.444690:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00100000:2.0:1788540932.454083:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540932.454254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323008 00000100:00100000:1.0:1788540932.454265:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323008 00000100:00100000:1.0:1788540932.454378:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:1.0:1788540932.454389:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323008:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540932.454733:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323008:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 344us (665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788540932.454743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 138 10000000:01000000:1.0:1788540932.567768:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788540932.567775:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d7bf6df000 from 39 10000000:01000000:1.0:1788540932.567779:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788540932.567825:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.567835:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.567845:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540932.567876:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968414848:0@lo:101: 00000100:00100000:1.0:1788540932.567940:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.567994:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.568054:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414848 00000100:00100000:0.0:1788540932.568062:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414848 00000100:00100000:0.0:1788540932.568116:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788540932.568126:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+12:5848:x1875420968414848:12345-0@lo:101: 00010000:00010000:0.0:1788540932.568139:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540932.568152:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1aa56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aa4f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.568175:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1aa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa4f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.568229:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1aa56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa4f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.568248:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031200, rc 0) 00000100:00100000:0.0:1788540932.568290:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968414848:12345-0@lo:101: Request processed in 165us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.568296:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788540932.568337:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968414848:0@lo:101: 00010000:00010000:0.0:1788540932.568351:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.568361:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540932.568442:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968414976:0@lo:501: 00000100:00100000:0.0:1788540932.568467:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.568484:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.568606:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968414976 00000100:00100000:1.0:1788540932.568611:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968414976 00000100:00100000:1.0:1788540932.568641:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788540932.568647:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968414976:12345-0@lo:501: 00000100:00100000:1.0:1788540932.568884:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968414976:12345-0@lo:501: Request processed in 236us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.568900:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788540932.569212:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968414976:0@lo:501: 00000100:00100000:0.0:1788540932.569246:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415104:0@lo:503: 00000100:00100000:0.0:1788540932.569283:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.569306:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.569319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415104 00000100:00100000:0.0:1788540932.569322:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415104 00000100:00100000:0.0:1788540932.569343:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788540932.569349:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968415104:12345-0@lo:503: 00000100:00100000:0.0:1788540932.569520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968415104:12345-0@lo:503: Request processed in 170us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.569532:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788540932.569566:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415104:0@lo:503: 00000100:00100000:1.0:1788540932.573758:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8477:1875420968415232:0@lo:502: 00000100:00100000:1.0:1788540932.573842:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.573891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415232 00000100:00100000:1.0:1788540932.573898:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415232 00000100:00100000:1.0:1788540932.573936:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788540932.573944:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:8477:x1875420968415232:12345-0@lo:502: 00000100:00100000:1.0:1788540932.574179:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:8477:x1875420968415232:12345-0@lo:502: Request processed in 234us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.574186:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788540932.574245:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.574264:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8477:1875420968415232:0@lo:502: 00000100:00100000:1.0:1788540932.574305:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8477:1875420968415360:0@lo:502: 00000100:00100000:1.0:1788540932.574336:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.574355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415360 00000100:00100000:1.0:1788540932.574359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415360 00000100:00100000:1.0:1788540932.574379:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788540932.574386:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:8477:x1875420968415360:12345-0@lo:502: 00000100:00100000:1.0:1788540932.574529:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:8477:x1875420968415360:12345-0@lo:502: Request processed in 143us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.574535:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788540932.574562:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.574575:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8477:1875420968415360:0@lo:502: 00000040:00080000:1.0:1788540932.574592:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788540932.574644:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788540932.574666:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788540932.574675:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574685:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540932.574695:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788540932.574698:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788540932.574701:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788540932.574725:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574733:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574742:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540932.574754:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415488:0@lo:101: 00000100:00100000:1.0:1788540932.574780:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.574793:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.574805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415488 00000100:00100000:1.0:1788540932.574808:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415488 00000100:00100000:1.0:1788540932.574827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788540932.574834:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+13:5848:x1875420968415488:12345-0@lo:101: 00010000:00010000:1.0:1788540932.574842:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540932.574854:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781679600/0xc9a6a13d3cd1aa64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aa5d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574890:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781679600/0xc9a6a13d3cd1aa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa5d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574901:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781679600/0xc9a6a13d3cd1aa64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa5d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574910:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781679600, rc 0) 00000100:00100000:1.0:1788540932.574938:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968415488:12345-0@lo:101: Request processed in 105us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.574944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788540932.574973:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415488:0@lo:101: 00010000:00010000:1.0:1788540932.574985:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.574994:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540932.575029:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415616:0@lo:501: 00000100:00100000:1.0:1788540932.575051:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.575063:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.575075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415616 00000100:00100000:1.0:1788540932.575078:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415616 00000100:00100000:1.0:1788540932.575094:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788540932.575100:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968415616:12345-0@lo:501: 00000100:00100000:1.0:1788540932.575308:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968415616:12345-0@lo:501: Request processed in 207us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.575315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788540932.575351:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415616:0@lo:501: 00000100:00100000:1.0:1788540932.575374:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415744:0@lo:503: 00000100:00100000:1.0:1788540932.575425:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.575438:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7872620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.575449:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415744 00000100:00100000:1.0:1788540932.575452:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415744 00000100:00100000:1.0:1788540932.575468:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788540932.575474:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968415744:12345-0@lo:503: 00000100:00100000:1.0:1788540932.575591:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968415744:12345-0@lo:503: Request processed in 117us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.575598:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788540932.575634:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968415744:0@lo:503: 00000100:00100000:0.0:1788540932.581634:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8478:1875420968415872:0@lo:502: 00000100:00100000:0.0:1788540932.581740:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.581781:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968415872 00000100:00100000:0.0:1788540932.581787:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968415872 00000100:00100000:0.0:1788540932.581827:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788540932.581835:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:8478:x1875420968415872:12345-0@lo:502: 00000100:00100000:0.0:1788540932.582074:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:8478:x1875420968415872:12345-0@lo:502: Request processed in 239us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.582082:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788540932.582131:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.582152:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8478:1875420968415872:0@lo:502: 00000020:01000000:0.0:1788540932.582180:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540932.582190:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540932.582193:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788540932.582198:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788540932.587199:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8478:1875420968416000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540932.587296:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.587326:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.587379:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416000 00000100:00100000:3.0:1788540932.587386:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416000 00000100:00100000:3.0:1788540932.587455:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788540932.587465:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:8478:x1875420968416000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.587681:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:8478:x1875420968416000:12345-0@lo:502:llog_process_th.0 Request processed in 206us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.587689:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788540932.587855:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8478:1875420968416000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788540932.587880:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540932.587885:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540932.587887:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788540932.587891:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788540932.588034:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788540932.588050:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788540932.588059:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.588070:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540932.588080:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540932.588088:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d7831d9800 from 39 10000000:01000000:3.0:1788540932.588091:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540932.588115:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.588123:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.588133:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540932.588147:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.588174:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.588214:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.588351:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416128 00000100:00100000:0.0:1788540932.588361:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416128 00000100:00100000:0.0:1788540932.588392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788540932.588398:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:5848:x1875420968416128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540932.588429:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540932.588441:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1aa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aa6b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.588462:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1aa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa6b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.588472:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1aa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa6b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.588481:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030400, rc 0) 00000100:00100000:0.0:1788540932.588515:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968416128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.588521:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788540932.588611:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788540932.588623:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.588632:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540932.588686:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540932.588710:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.588732:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.588822:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416256 00000100:00100000:0.0:1788540932.588825:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416256 00000100:00100000:0.0:1788540932.588851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788540932.588857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968416256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.589129:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968416256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.589137:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788540932.590842:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.590902:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.590973:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.591014:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788540932.591099:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416384 00000100:00100000:1.0:1788540932.591105:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416384 00000100:00100000:1.0:1788540932.591146:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788540932.591154:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968416384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788540932.591382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968416384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540932.591389:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788540932.591571:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788540932.591876:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8480:1875420968416512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540932.591910:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.591936:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.591970:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416512 00000100:00100000:0.0:1788540932.591974:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416512 00000100:00100000:0.0:1788540932.592002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788540932.592009:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:8480:x1875420968416512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540932.592210:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:8480:x1875420968416512:12345-0@lo:502:llog_process_th.0 Request processed in 192us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.592218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788540932.592344:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8480:1875420968416512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.592379:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8480:1875420968416640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.592433:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.592448:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.592525:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416640 00000100:00100000:0.0:1788540932.592529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416640 00000100:00100000:0.0:1788540932.592555:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788540932.592561:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:8480:x1875420968416640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540932.592765:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:8480:x1875420968416640:12345-0@lo:502:llog_process_th.0 Request processed in 203us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.592772:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788540932.595271:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8480:1875420968416640:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788540932.595320:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788540932.596137:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788540932.596162:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540932.596173:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596185:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540932.596194:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788540932.596197:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788540932.596212:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788540932.596247:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596255:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596265:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540932.596297:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.596362:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.596398:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7890986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.596626:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416768 00000100:00100000:0.0:1788540932.596633:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416768 00000100:00100000:0.0:1788540932.596673:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788540932.596682:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:5848:x1875420968416768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540932.596698:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540932.596711:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031a00/0xc9a6a13d3cd1aa80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aa79 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596735:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031a00/0xc9a6a13d3cd1aa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa79 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596746:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031a00/0xc9a6a13d3cd1aa80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa79 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596754:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031a00, rc 0) 00000100:00100000:0.0:1788540932.596787:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968416768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.596793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788540932.596866:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540932.596882:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540932.596890:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540932.596945:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.596970:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.596988:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78315ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.597000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968416896 00000100:00100000:0.0:1788540932.597003:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968416896 00000100:00100000:0.0:1788540932.597024:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788540932.597029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968416896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.597262:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968416896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.597269:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788540932.597298:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968416896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.597322:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.597358:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.597371:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78315ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.597381:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417024 00000100:00100000:0.0:1788540932.597384:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417024 00000100:00100000:0.0:1788540932.597405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788540932.597434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968417024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.597577:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968417024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.597584:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788540932.597623:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.598279:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8481:1875420968417152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540932.598325:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540932.598349:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417152 00000100:00100000:0.0:1788540932.598353:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417152 00000100:00100000:0.0:1788540932.598380:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788540932.598450:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:8481:x1875420968417152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540932.598750:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:8481:x1875420968417152:12345-0@lo:502:llog_process_th.0 Request processed in 362us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.598758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788540932.598985:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78315fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.599018:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8481:1875420968417152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540932.610456:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540932.610478:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540932.610481:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788540932.610492:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788540932.610548:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8481:1875420968417280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540932.610634:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540932.610679:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.610764:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417280 00000100:00100000:3.0:1788540932.610779:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417280 00000100:00100000:3.0:1788540932.610823:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788540932.610832:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:8481:x1875420968417280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.611047:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:8481:x1875420968417280:12345-0@lo:502:llog_process_th.0 Request processed in 216us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.611055:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788540932.611252:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8481:1875420968417280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540932.611278:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540932.611284:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540932.611286:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788540932.611290:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788540932.611483:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788540932.611501:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788540932.611511:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.611522:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540932.611532:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540932.611535:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d782e54800 from 39 10000000:01000000:3.0:1788540932.611538:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540932.611564:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.611572:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.611581:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540932.611596:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.611625:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.611657:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540932.611756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417408 00000100:00100000:2.0:1788540932.611761:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417408 00000100:00100000:2.0:1788540932.611796:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788540932.611803:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968417408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540932.611817:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540932.611828:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1aa8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aa87 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.611850:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1aa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa87 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.611860:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1aa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa87 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.611870:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fc600, rc 0) 00000100:00100000:2.0:1788540932.611899:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968417408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540932.611905:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788540932.611966:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540932.611979:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.611988:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540932.612032:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.612054:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.612075:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.612087:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417536 00000100:00100000:3.0:1788540932.612090:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417536 00000100:00100000:3.0:1788540932.612112:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788540932.612119:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968417536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.612363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968417536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.612371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788540932.612402:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.612457:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.612492:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.612506:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.612518:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417664 00000100:00100000:3.0:1788540932.612521:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417664 00000100:00100000:3.0:1788540932.612538:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788540932.612544:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968417664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.612699:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968417664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.612712:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788540932.612746:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968417664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540932.614914:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8482:1875420968417792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540932.614991:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540932.615031:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.615077:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417792 00000100:00100000:3.0:1788540932.615084:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417792 00000100:00100000:3.0:1788540932.615126:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788540932.615135:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8482:x1875420968417792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.615368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8482:x1875420968417792:12345-0@lo:502:llog_process_th.0 Request processed in 234us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.615375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788540932.615449:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8482:1875420968417792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.615494:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8482:1875420968417920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.615528:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.615551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968417920 00000100:00100000:3.0:1788540932.615554:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968417920 00000100:00100000:3.0:1788540932.615575:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788540932.615582:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8482:x1875420968417920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.615913:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8482:x1875420968417920:12345-0@lo:502:llog_process_th.0 Request processed in 330us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.615920:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788540932.615954:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.615966:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8482:1875420968417920:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788540932.615985:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788540932.616035:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788540932.616050:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788540932.616067:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616077:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540932.616088:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788540932.616090:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788540932.616093:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540932.616116:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616124:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616133:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540932.616146:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.616172:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.616189:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.616211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418048 00000100:00100000:3.0:1788540932.616215:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418048 00000100:00100000:3.0:1788540932.616235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788540932.616241:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968418048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540932.616250:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540932.616262:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1aa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aa95 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616284:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1aa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa95 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616303:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1aa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa95 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616311:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bcc00, rc 0) 00000100:00100000:3.0:1788540932.616341:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968418048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.616346:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788540932.616374:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540932.616387:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.616395:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540932.616463:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.616487:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.616501:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.616525:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418176 00000100:00100000:3.0:1788540932.616528:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418176 00000100:00100000:3.0:1788540932.616548:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788540932.616554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968418176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.616968:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968418176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 412us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.616976:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788540932.617006:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.617044:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.617077:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.617097:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.617107:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418304 00000100:00100000:3.0:1788540932.617110:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418304 00000100:00100000:3.0:1788540932.617131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788540932.617137:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968418304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.617268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968418304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.617275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788540932.617310:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788540932.619137:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8483:1875420968418432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540932.619219:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.619245:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788540932.619312:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418432 00000100:00100000:3.0:1788540932.619320:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418432 00000100:00100000:3.0:1788540932.619357:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788540932.619371:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8483:x1875420968418432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540932.619792:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8483:x1875420968418432:12345-0@lo:502:llog_process_th.0 Request processed in 426us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.619799:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788540932.620157:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8483:1875420968418432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788540932.620186:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540932.620195:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540932.620198:0:8483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788540932.620215:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788540932.620241:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8483:1875420968418560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540932.620275:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540932.620308:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788540932.620368:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418560 00000100:00100000:2.0:1788540932.620374:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418560 00000100:00100000:2.0:1788540932.620442:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788540932.620594:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8483:x1875420968418560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540932.620768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8483:x1875420968418560:12345-0@lo:502:llog_process_th.0 Request processed in 319us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540932.623980:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8483:1875420968418560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788540932.624029:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540932.624040:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540932.624042:0:8483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788540932.624047:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788540932.624721:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788540932.624741:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788540932.624753:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.624765:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540932.624792:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788540932.624794:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d7b2f70000 from 1 10000000:01000000:3.0:1788540932.624798:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788540932.624834:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.624842:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540932.624852:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540932.624876:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540932.624940:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.624984:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540932.625507:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788540932.625554:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418688 00000100:00100000:2.0:1788540932.625561:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418688 00000100:00100000:2.0:1788540932.625607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788540932.625615:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968418688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540932.625634:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540932.625647:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1aaaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aaa3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.625673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1aaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aaa3 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.625685:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1aaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aaa3 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.625692:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fc000, rc 0) 00000100:00100000:2.0:1788540932.625737:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968418688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540932.625743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788540932.625779:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540932.625794:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.625802:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540932.625855:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540932.625881:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540932.625914:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788540932.625978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968418816 00000100:00100000:0.0:1788540932.625982:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968418816 00000100:00100000:0.0:1788540932.626012:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788540932.626019:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968418816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540932.626268:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968418816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788540932.626275:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788540932.626506:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968418816:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788540932.626529:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788540932.626535:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540932.626550:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540932.696723:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788540933.237566:0:8522:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca3aaef30 20000000:00000080:0.0:1788540933.237583:0:8522:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d68185b800 uarg=0000000000000000 20000000:01000000:0.0:1788540933.237618:0:8522:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788540933.237623:0:8522:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788540933.237634:0:8522:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788540933.238755:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788540933.238950:0:8522:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788540933.244282:0:8522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788540933.244345:0:8522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788540933.244405:0:8522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788540933.247922:0:8522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788540933.247948:0:8522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.247968:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.247976:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.247984:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.247994:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.248000:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.248040:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.248053:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 9 pid: 5844 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.248065:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968418944:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788540933.248179:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.248211:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 18 pid: 5844 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.248221:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968419072:0@lo:104: 00000100:00100000:0.0:1788540933.248267:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540933.248344:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.248352:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 18 pid: 5842 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.248359:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968419200:0@lo:104: 00000100:00100000:0.0:1788540933.248379:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540933.249349:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.249360:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 18 pid: 5843 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.249370:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968419328:0@lo:104: 00000100:00100000:0.0:1788540933.249402:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540933.250884:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419072 00000100:00100000:3.0:1788540933.250897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419072 00000100:00100000:3.0:1788540933.250945:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419200 00000100:00100000:3.0:1788540933.250948:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419200 00000100:00100000:3.0:1788540933.250965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788540933.250973:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:8522:x1875420968419072:12345-0@lo:104: 00010000:00010000:3.0:1788540933.250989:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.251078:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788540933.251084:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:8522:x1875420968419072:12345-0@lo:104: Request processed in 112us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.251101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788540933.251119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540933.251125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8522:x1875420968419200:12345-0@lo:104: 00010000:00010000:3.0:1788540933.251134:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.251172:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788540933.251178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8522:x1875420968419200:12345-0@lo:104: Request processed in 54us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.251183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788540933.251426:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540933.251448:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad256680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968419072:0@lo:104: 00000100:00100000:0.0:1788540933.251456:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968419200:0@lo:104: 00010000:00010000:0.0:1788540933.251484:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788540933.251491:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251508:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fcc00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540933.251513:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251521:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540933.251528:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540933.251534:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788540933.251569:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251575:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540933.251594:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251601:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7813fcc00/0xc9a6a13d3cd1a94c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a953 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251613:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540933.251616:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251623:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788540933.251625:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251642:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540933.251660:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540933.251770:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788540933.251784:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251790:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540933.251796:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251802:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bd200/0xc9a6a13d3cd1a881 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a888 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.251811:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540933.251812:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540933.251814:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540933.251826:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968419456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788540933.251870:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540933.251891:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788540933.251896:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968419584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788540933.251915:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540933.251940:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419456 00000100:00100000:0.0:1788540933.251944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419456 00010000:00010000:0.0:1788540933.251966:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 19 pid: 5844 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.251998:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419584 00000100:00100000:0.0:1788540933.252001:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419584 00010000:00010000:0.0:1788540933.252014:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 20 pid: 5842 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.252029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788540933.252035:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+20:3316:x1875420968419456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788540933.252046:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540933.252051:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 20 pid: 5844 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.252059:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 20 pid: 5844 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.252072:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031000/0xc9a6a13d3cd1a953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a94c expref: 20 pid: 5844 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.252085:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540933.252113:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968419456:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.252119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788540933.252133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788540933.252139:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3316:x1875420968419584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788540933.252147:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540933.252151:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 18 pid: 5842 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.252159:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 18 pid: 5842 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.252176:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781678400/0xc9a6a13d3cd1a888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a881 expref: 18 pid: 5842 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.252184:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540933.252218:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3316:x1875420968419584:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.252225:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788540933.252257:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968419584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788540933.252265:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968419456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788540933.254304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419328 00000100:00100000:3.0:1788540933.254318:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419328 00000100:00100000:3.0:1788540933.254360:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788540933.254379:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8522:x1875420968419328:12345-0@lo:104: 00010000:00010000:3.0:1788540933.254396:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254494:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788540933.254500:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:8522:x1875420968419328:12345-0@lo:104: Request processed in 123us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.254507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788540933.254526:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788540933.254531:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254538:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fc800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788540933.254543:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254560:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788540933.254568:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540933.254573:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788540933.254601:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254607:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788540933.254626:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254634:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1a81f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1a826 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254658:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540933.254660:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540933.254662:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540933.254833:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968419712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788540933.254870:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540933.254917:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419712 00000100:00100000:3.0:1788540933.254922:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419712 00010000:00010000:3.0:1788540933.254937:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 17 pid: 5843 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540933.254956:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788540933.254961:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968419712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788540933.254976:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540933.254980:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 17 pid: 5843 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.254990:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 17 pid: 5843 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.255004:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540933.255027:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968419712:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.255033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788540933.255062:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968419712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788540933.255213:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968418944:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788540933.255225:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1a826 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1a81f expref: 16 pid: 5843 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.255236:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875420968419328:0@lo:104: 00010000:00010000:0.0:1788540933.255263:0:8522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540933.255345:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540933.256036:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540933.256092:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323136 00000100:00100000:0.0:1788540933.256098:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323136 00010000:00010000:0.0:1788540933.256119:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 10 pid: 5844 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.256147:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:0.0:1788540933.256155:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945323136:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788540933.256166:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540933.256170:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 10 pid: 5844 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256187:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 10 pid: 5844 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256211:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aa10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14d2 expref: 10 pid: 5844 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256224:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256232:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256247:0:6720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256255:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256262:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256269:0:6720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256274:0:6720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788540933.256279:0:6720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256286:0:6720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256319:0:6720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.256330:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540933.256376:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:2358:x1875420945323136:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 215us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.256383:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00010000:00010000:2.0:1788540933.256521:0:8522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540933.256530:0:8522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540933.256535:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1aab1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.719647:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540933.763770:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540933.764927:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540933.764968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540933.765008:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323264 00000100:00100000:1.0:1788540933.765019:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323264 00000100:00100000:1.0:1788540933.765081:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:1.0:1788540933.765091:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945323264:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540933.765164:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945323264:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540933.765172:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00080000:1.0:1788540933.765210:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540933.770766:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323392 00000100:00100000:3.0:1788540933.770784:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323392 00000100:00100000:3.0:1788540933.770915:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323520 00000100:00100000:3.0:1788540933.770920:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323520 00000100:00100000:1.0:1788540933.771070:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1788540933.771084:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945323392:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540933.771172:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945323392:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 91us (7411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540933.771180:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00080000:0.0:1788540933.779073:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540933.779082:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540933.780158:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788540933.780173:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945323520:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540933.780271:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945323520:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 102us (15302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.780279:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 10000000:01000000:2.0:1788540933.975467:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788540933.975474:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7bf6df000 from 4 10000000:01000000:2.0:1788540933.975478:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540933.975527:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540933.975539:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540933.975551:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540933.975587:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968419840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788540933.975653:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540933.975703:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540933.975721:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419840 00000100:00100000:0.0:1788540933.975729:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419840 00000100:00100000:0.0:1788540933.975785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788540933.975795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968419840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540933.975809:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540933.975823:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aab8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.975846:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.975868:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.975878:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030000, rc 0) 00000100:00100000:0.0:1788540933.975920:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968419840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.975933:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788540933.975943:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968419840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540933.975956:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540933.975965:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540933.976014:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968419968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540933.976041:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540933.976063:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540933.976088:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968419968 00000100:00100000:0.0:1788540933.976093:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968419968 00000100:00100000:0.0:1788540933.976115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788540933.976122:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968419968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540933.976378:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968419968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.976385:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788540933.976401:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968419968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540933.976462:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540933.976496:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540933.976518:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540933.976534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420096 00000100:00100000:0.0:1788540933.976538:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420096 00000100:00100000:0.0:1788540933.976711:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788540933.976719:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968420096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540933.977007:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968420096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 289us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.977014:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788540933.977110:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788540933.981719:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8546:1875420968420224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540933.981801:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540933.981848:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788540933.981963:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420224 00000100:00100000:3.0:1788540933.981971:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420224 00000100:00100000:3.0:1788540933.982021:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788540933.982031:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8546:x1875420968420224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540933.982322:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8546:x1875420968420224:12345-0@lo:502:llog_process_th.0 Request processed in 292us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.982337:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788540933.982551:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8546:1875420968420224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788540933.982592:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540933.982603:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540933.982605:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788540933.982616:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d7bf6df000 00000020:00000080:1.0:1788540933.982619:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788540933.982695:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8546:1875420968420352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540933.982733:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540933.982759:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788540933.991402:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420352 00000100:00100000:0.0:1788540933.991446:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420352 00000100:00100000:0.0:1788540933.991497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788540933.991508:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8546:x1875420968420352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540933.991777:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:8546:x1875420968420352:12345-0@lo:502:llog_process_th.0 Request processed in 270us (9041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.991785:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788540933.992105:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8546:1875420968420352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788540933.992141:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540933.992149:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540933.992151:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788540933.992159:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788540933.992683:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788540933.992701:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788540933.992712:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.992734:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540933.992745:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788540933.992748:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7831d9800 from 4 10000000:01000000:0.0:1788540933.992751:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788540933.992783:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.992792:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.992801:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.992823:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788540933.992867:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540933.992907:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540933.993515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420480 00000100:00100000:3.0:1788540933.993522:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420480 00000100:00100000:3.0:1788540933.993606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788540933.993619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968420480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540933.993630:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540933.993643:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aac6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.993665:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.993675:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540933.993683:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bde00, rc 0) 00000100:00100000:3.0:1788540933.993724:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968420480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.993730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788540933.994740:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540933.994763:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540933.994774:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540933.994847:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540933.994889:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540933.994934:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b503aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540933.995949:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420608 00000100:00100000:3.0:1788540933.995959:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420608 00000100:00100000:3.0:1788540933.996012:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788540933.996021:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968420608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540933.996322:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968420608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540933.996331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788540933.997536:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540933.998516:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540933.999486:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540933.999531:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bff64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540933.999624:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420736 00000100:00100000:0.0:1788540933.999632:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420736 00000100:00100000:0.0:1788540933.999688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788540933.999699:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968420736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540933.999919:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968420736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540933.999927:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788540934.000023:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968420736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540934.004591:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8549:1875420968420864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540934.004680:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540934.004724:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786073900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.004888:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420864 00000100:00100000:3.0:1788540934.004897:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420864 00000100:00100000:3.0:1788540934.004942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788540934.004952:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8549:x1875420968420864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540934.005295:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8549:x1875420968420864:12345-0@lo:502:llog_process_th.0 Request processed in 343us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.005303:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788540934.005980:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8549:1875420968420864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788540934.006020:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540934.006031:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540934.006034:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788540934.006041:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d7831d9800 00000020:00000080:0.0:1788540934.006043:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788540934.006140:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8549:1875420968420992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540934.006196:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540934.006222:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7909f7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.006699:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968420992 00000100:00100000:3.0:1788540934.006706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968420992 00000100:00100000:3.0:1788540934.006749:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788540934.006758:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8549:x1875420968420992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540934.006946:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:8549:x1875420968420992:12345-0@lo:502:llog_process_th.0 Request processed in 189us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.006955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788540934.007311:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8549:1875420968420992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788540934.007338:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540934.007345:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540934.007347:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788540934.007362:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788540934.008466:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788540934.008492:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788540934.008501:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008512:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540934.008529:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788540934.008531:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d782e54800 from 4 10000000:01000000:3.0:1788540934.008533:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788540934.008562:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008570:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008580:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540934.008602:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968421120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.008657:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540934.008697:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bff64e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.008717:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421120 00000100:00100000:3.0:1788540934.008723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421120 00000100:00100000:3.0:1788540934.008761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788540934.008769:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968421120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540934.008779:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540934.008792:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aad4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008814:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008824:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008844:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd000, rc 0) 00000100:00100000:3.0:1788540934.008878:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968421120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.008883:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788540934.008918:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968421120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540934.008929:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540934.008935:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540934.008967:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968421248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.008982:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540934.008994:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786c390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.009003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421248 00000100:00100000:3.0:1788540934.009005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421248 00000100:00100000:3.0:1788540934.009018:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788540934.009022:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968421248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.009245:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968421248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.009252:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788540934.009282:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968421248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.009308:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968421376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.009343:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540934.010279:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786c390c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.010299:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421376 00000100:00100000:3.0:1788540934.010304:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421376 00000100:00100000:3.0:1788540934.010397:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788540934.010405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968421376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.010594:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968421376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.010601:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788540934.014981:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968421376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.023378:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8551:1875420968421504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540934.023475:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540934.023513:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421504 00000100:00100000:3.0:1788540934.023520:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421504 00000100:00100000:3.0:1788540934.023560:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788540934.023569:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:8551:x1875420968421504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540934.023777:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:8551:x1875420968421504:12345-0@lo:502:llog_process_th.0 Request processed in 208us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.023785:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788540934.023836:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb5193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.023859:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8551:1875420968421504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540934.023886:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540934.023895:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540934.023898:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788540934.023904:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d782e54800 00000020:00000080:3.0:1788540934.023907:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788540934.023969:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8551:1875420968421632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540934.024007:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540934.024027:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421632 00000100:00100000:3.0:1788540934.024031:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421632 00000100:00100000:3.0:1788540934.024049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788540934.024055:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:8551:x1875420968421632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540934.024150:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:8551:x1875420968421632:12345-0@lo:502:llog_process_th.0 Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.024157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788540934.024198:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb5193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540934.024212:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:8551:1875420968421632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540934.024228:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540934.024232:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540934.024234:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788540934.024238:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788540934.024961:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788540934.024981:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788540934.024992:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540934.025014:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540934.077305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540934.082593:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323648 00000100:00100000:3.0:1788540934.082612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323648 00000100:00100000:2.0:1788540934.082991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 186 00000100:00100000:2.0:1788540934.083003:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:5600:x1875420945323648:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540934.083020:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540934.083038:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1511 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540934.083070:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540934.083083:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540934.083103:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fcc00, rc 0) 00000100:00100000:2.0:1788540934.083163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323648:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 161us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540934.083170:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 186 00000100:00100000:3.0:1788540934.085517:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540934.085695:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323776 00000100:00100000:1.0:1788540934.085703:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323776 00000100:00100000:1.0:1788540934.085853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 187 00000100:00100000:1.0:1788540934.085863:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323776:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540934.086142:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323776:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 280us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540934.086151:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 187 00000100:00100000:1.0:1788540934.091264:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540934.091348:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945323904 00000100:00100000:3.0:1788540934.091368:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945323904 00000100:00100000:3.0:1788540934.091516:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 188 00000100:00100000:3.0:1788540934.091527:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323904:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540934.091773:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:5600:x1875420945323904:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 248us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.091782:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 188 00000100:00100000:2.0:1788540934.108625:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968421760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788540934.108697:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540934.109072:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540934.109300:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324032 00000100:00100000:3.0:1788540934.109309:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324032 00000100:00100000:3.0:1788540934.109374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:3.0:1788540934.109390:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:6121:x1875420945324032:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788540934.109638:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:6121:x1875420945324032:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 249us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.109647:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:3.0:1788540934.111017:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421760 00000100:00100000:3.0:1788540934.111028:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421760 00000100:00100000:3.0:1788540934.111090:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788540934.111100:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968421760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788540934.111132:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788540934.111217:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540934.112092:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968421760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 990us (3391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540934.112102:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788540934.113685:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc719180 x1875420968421760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540934.113713:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968421760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788540934.117832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540934.117905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324160 00000100:00100000:0.0:1788540934.117915:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324160 00000100:00100000:0.0:1788540934.117973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00100000:0.0:1788540934.117984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:6121:x1875420945324160:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788540934.118248:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:6121:x1875420945324160:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 265us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540934.118257:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 190 00010000:00010000:2.0:1788540934.743671:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540935.127762:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968422144:0@lo:400:kworker.0 00000100:00100000:0.0:1788540935.127831:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540935.127897:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540935.127904:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968422272:0@lo:400:kworker.0 00000100:00100000:0.0:1788540935.127932:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540935.127984:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968421888:0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128018:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540935.128044:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968422400:0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128066:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540935.128085:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788540935.128090:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968422016:0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128110:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540935.128126:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968422528:0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128156:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422144 00000100:00100000:1.0:1788540935.128163:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422144 00000100:00100000:1.0:1788540935.128221:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422400 00000100:00100000:1.0:1788540935.128225:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422400 00000100:00100000:1.0:1788540935.128253:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422016 00000100:00100000:1.0:1788540935.128256:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422016 00000100:00100000:1.0:1788540935.128292:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788540935.128300:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128360:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968422144:12345-0@lo:400:kworker.0 Request processed in 61us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540935.128368:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788540935.128385:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788540935.128390:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968422400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128445:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968422400:12345-0@lo:400:kworker.0 Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540935.128452:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788540935.128464:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540935.128470:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128498:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968422016:12345-0@lo:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540935.128504:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540935.128521:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968421888 00000100:00100000:1.0:1788540935.128525:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968421888 00000100:00100000:1.0:1788540935.128551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788540935.128557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968421888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.128587:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968421888:12345-0@lo:400:kworker.0 Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540935.128593:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1788540935.128623:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540935.140763:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422272 00000100:00100000:3.0:1788540935.140779:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422272 00000100:00100000:3.0:1788540935.140853:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788540935.140863:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968422272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540935.140941:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968422272:12345-0@lo:400:kworker.0 Request processed in 79us (13008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540935.140948:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540935.141082:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540935.141132:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968421888:0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.141147:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968422400:0@lo:400:kworker.0 00000100:00100000:1.0:1788540935.141199:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968422016:0@lo:400:kworker.0 00010000:00080000:1.0:1788540935.141334:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc719180 x1875420968422272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540935.141566:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422528 00000100:00100000:3.0:1788540935.141571:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422528 00000100:00100000:3.0:1788540935.141614:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788540935.141622:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968422528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540935.141666:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968422528:12345-0@lo:400:kworker.0 Request processed in 45us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540935.141682:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788540935.141712:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc719c00 x1875420968422528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540935.141722:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968422528:0@lo:400:kworker.0 00000100:00080000:0.0:1788540935.141763:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788540935.141809:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968422272:0@lo:400:kworker.0 00000100:00100000:0.0:1788540935.141920:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788540935.640698:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788540935.640732:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788540935.640806:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540935.640955:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422656 00000100:00100000:1.0:1788540935.640964:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422656 00000100:00100000:1.0:1788540935.641020:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540935.641030:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968422656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788540935.641066:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540935.641110:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968422656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540935.641117:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788540935.641318:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7aeca2d80 x1875420968422656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540935.641348:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968422656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788540935.767631:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540936.791554:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540937.822684:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540938.840581:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540938.878495:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540938.878530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540938.878549:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540938.878579:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540938.878600:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324544 00000100:00100000:0.0:1788540938.878608:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324544 00000100:00100000:0.0:1788540938.878668:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324672 00000100:00100000:0.0:1788540938.878672:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324672 00000100:00100000:0.0:1788540938.878692:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1788540938.878703:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945324544:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540938.878770:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945324544:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540938.878785:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1788540938.878802:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1788540938.878809:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945324672:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540938.878830:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945324672:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 23us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540938.878834:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00080000:0.0:1788540938.878846:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540938.878849:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540938.879096:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324288 00000100:00100000:3.0:1788540938.879101:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324288 00000100:00100000:3.0:1788540938.879139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 192 00000100:00100000:3.0:1788540938.879157:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945324288:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540938.879185:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945324288:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 40us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540938.879191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 192 00000100:00100000:1.0:1788540938.879897:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324416 00000100:00100000:1.0:1788540938.879904:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324416 00000100:00100000:1.0:1788540938.879994:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:1.0:1788540938.880003:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945324416:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540938.880058:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945324416:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 56us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540938.880065:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00080000:0.0:1788540938.882111:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788540939.135570:0:8820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788540939.224004:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540939.224029:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968422784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788540939.224101:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540939.225867:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422784 00000100:00100000:0.0:1788540939.225881:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422784 00000100:00100000:0.0:1788540939.225957:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788540939.225970:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968422784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788540939.226009:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788540939.227041:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540939.228761:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968422784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2786us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540939.228777:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788540939.229281:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d6828eed80 x1875420968422784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540939.229306:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968422784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788540939.864760:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540940.248300:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968423040:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248373:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540940.248448:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968423552:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248476:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540940.248517:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788540940.248524:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968422912:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248551:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540940.248572:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968423424:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248591:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540940.248641:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423552 00000100:00100000:0.0:1788540940.248648:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423552 00000100:00100000:0.0:1788540940.248704:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788540940.248713:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968423552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248766:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968423552:12345-0@lo:400:kworker.0 Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540940.248773:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788540940.248794:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788540940.248820:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc719c00 x1875420968423552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540940.248833:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968423552:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248864:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423040 00000100:00100000:0.0:1788540940.248869:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423040 00000100:00100000:0.0:1788540940.248890:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423424 00000100:00100000:0.0:1788540940.248894:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423424 00000100:00100000:0.0:1788540940.248912:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788540940.248919:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968423040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.248953:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968423040:12345-0@lo:400:kworker.0 Request processed in 35us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540940.248959:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788540940.248969:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788540940.248974:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249008:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968423424:12345-0@lo:400:kworker.0 Request processed in 33us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540940.249014:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788540940.249033:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968423296:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249058:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540940.249079:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540940.249086:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968423168:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249107:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788540940.249147:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540940.249156:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423168 00000100:00100000:0.0:1788540940.249159:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423168 00000100:00100000:0.0:1788540940.249183:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788540940.249189:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968423168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249220:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968423168:12345-0@lo:400:kworker.0 Request processed in 31us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540940.249226:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788540940.249238:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540940.249256:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968423168:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249285:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968423424:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249296:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968423040:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968422912 00000100:00100000:0.0:1788540940.249325:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968422912 00000100:00100000:0.0:1788540940.249349:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788540940.249355:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968422912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.249386:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968422912:12345-0@lo:400:kworker.0 Request processed in 31us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540940.249398:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788540940.249456:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968422912:0@lo:400:kworker.0 00000100:00100000:1.0:1788540940.251533:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423296 00000100:00100000:1.0:1788540940.251548:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423296 00000100:00100000:1.0:1788540940.251607:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540940.251630:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968423296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540940.251719:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968423296:12345-0@lo:400:kworker.0 Request processed in 103us (2659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540940.251737:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788540940.251785:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc719f80 x1875420968423296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540940.251800:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968423296:0@lo:400:kworker.0 00000100:00100000:0.0:1788540940.762593:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968423680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788540940.762665:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540940.762760:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423680 00000100:00100000:2.0:1788540940.762769:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423680 00000100:00100000:2.0:1788540940.762832:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540940.762841:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968423680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788540940.762877:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540940.768113:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968423680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5264us (5439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540940.768139:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788540940.770069:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb475880 x1875420968423680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540940.770097:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968423680:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788540940.888562:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540941.912735:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540942.935610:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540943.959588:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540944.003518:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540944.003556:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540944.003582:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540944.003606:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540944.003631:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324928 00000100:00100000:0.0:1788540944.003639:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324928 00000100:00100000:0.0:1788540944.003698:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:0.0:1788540944.003711:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945324928:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540944.003781:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945324928:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540944.003789:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:2.0:1788540944.003912:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945324800 00000100:00100000:2.0:1788540944.003916:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945324800 00000100:00100000:2.0:1788540944.003947:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:2.0:1788540944.003953:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945324800:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540944.003980:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945324800:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540944.003986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00080000:0.0:1788540944.004093:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540944.004298:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325056 00000100:00100000:0.0:1788540944.004303:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325056 00000100:00100000:0.0:1788540944.004342:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325184 00000100:00100000:0.0:1788540944.004345:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325184 00000100:00100000:0.0:1788540944.004361:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1788540944.004367:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945325056:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540944.004447:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945325056:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 79us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540944.004455:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1788540944.004469:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1788540944.004476:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945325184:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540944.004500:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945325184:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (892us total) trans 0 rc 0/0 00000100:00080000:2.0:1788540944.004591:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788540944.004594:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788540944.004641:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1788540944.343644:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540944.343670:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968423808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788540944.343752:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540944.343821:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423808 00000100:00100000:0.0:1788540944.343829:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423808 00000100:00100000:0.0:1788540944.343882:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788540944.343890:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968423808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788540944.343930:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788540944.343973:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968423808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540944.343981:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788540944.344004:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788540944.344035:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d6828ed500 x1875420968423808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540944.344051:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968423808:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788540944.673963:0:9064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing yml_node 00010000:00010000:2.0:1788540944.986140:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540945.368633:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968424064:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.368722:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540945.368771:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968424576:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.368797:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540945.368828:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788540945.368833:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968423936:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.368861:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540945.368879:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968424448:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.368900:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540945.368923:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968424192:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.368945:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540945.368963:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788540945.368985:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968424320:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369006:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540945.369035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424064 00000100:00100000:1.0:1788540945.369041:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424064 00000100:00100000:1.0:1788540945.369075:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424448 00000100:00100000:1.0:1788540945.369078:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424448 00000100:00100000:1.0:1788540945.369112:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424192 00000100:00100000:1.0:1788540945.369115:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424192 00000100:00100000:1.0:1788540945.369145:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788540945.369152:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968424064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369200:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968424064:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540945.369207:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788540945.369223:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788540945.369229:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968424448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369268:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968424448:12345-0@lo:400:kworker.0 Request processed in 39us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540945.369274:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788540945.369285:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788540945.369291:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968424192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369321:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968424192:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540945.369326:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788540945.369342:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424576 00000100:00100000:1.0:1788540945.369345:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424576 00000100:00100000:1.0:1788540945.369366:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424320 00000100:00100000:1.0:1788540945.369369:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424320 00000100:00100000:1.0:1788540945.369381:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788540945.369385:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968424576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369436:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968424576:12345-0@lo:400:kworker.0 Request processed in 50us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540945.369442:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788540945.369452:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788540945.369457:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968424320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369493:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968424320:12345-0@lo:400:kworker.0 Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540945.369498:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788540945.369515:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968423936 00000100:00100000:1.0:1788540945.369518:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968423936 00000100:00100000:1.0:1788540945.369543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788540945.369549:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968423936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369578:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968423936:12345-0@lo:400:kworker.0 Request processed in 29us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540945.369583:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:1.0:1788540945.369656:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc71b800 x1875420968424320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540945.369671:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968424320:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369682:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968424192:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369713:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968423936:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369720:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968424448:0@lo:400:kworker.0 00000100:00100000:1.0:1788540945.369728:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968424064:0@lo:400:kworker.0 00010000:00080000:1.0:1788540945.369737:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bc719c00 x1875420968424576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540945.369746:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968424576:0@lo:400:kworker.0 00000100:00080000:0.0:1788540945.370150:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540945.370157:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540945.888748:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968424704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788540945.888818:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540945.888928:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424704 00000100:00100000:3.0:1788540945.888936:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424704 00000100:00100000:3.0:1788540945.888982:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788540945.888990:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968424704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788540945.889030:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540945.890061:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968424704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1066us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540945.890072:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788540945.892226:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb477480 x1875420968424704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540945.892264:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb477480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968424704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788540946.008569:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540947.032552:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540948.055855:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540949.084720:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540949.133301:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540949.133345:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540949.133384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540949.133451:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325568 00000100:00100000:0.0:1788540949.133462:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325568 00000100:00100000:0.0:1788540949.133520:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1788540949.133532:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2357:x1875420945325568:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:0.0:1788540949.133567:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1aa1e 00000100:00080000:0.0:1788540949.133577:0:6705:0:(import.c:65:import_set_state_nolock()) ffff98d7b5266800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788540949.133734:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325312 00000100:00100000:2.0:1788540949.133738:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325312 00000100:00100000:2.0:1788540949.133769:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:2.0:1788540949.133776:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945325312:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540949.133836:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945325312:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 60us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540949.133843:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:3.0:1788540949.134201:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325440 00000100:00100000:3.0:1788540949.134206:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325440 00000100:00100000:3.0:1788540949.134251:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1788540949.134260:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945325440:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540949.134483:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945325440:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 224us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540949.134491:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00010000:00010000:3.0:1788540949.134510:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540949.134542:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540949.134628:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788540949.134636:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788540949.134783:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325696 00000100:00100000:3.0:1788540949.134789:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325696 00000100:00100000:3.0:1788540949.134872:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1788540949.134879:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2357:x1875420945325696:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:3.0:1788540949.134902:0:9248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1aa25 00000100:00080000:3.0:1788540949.134911:0:9248:0:(import.c:65:import_set_state_nolock()) ffff98d7b5261000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788540949.134983:0:9248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788540949.135301:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+2:2357:x1875420945325696:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 421us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540949.135309:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00080000:3.0:1788540949.135351:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788540949.135356:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788540949.135358:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788540949.135870:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788540949.136727:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788540949.137035:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+2:2357:x1875420945325568:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 3500us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540949.137046:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000001:02000400:1.0:1788540949.274510:0:9258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:0.0:1788540949.463602:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540949.463625:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968424832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788540949.463692:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540949.463806:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424832 00000100:00100000:3.0:1788540949.463814:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424832 00000100:00100000:3.0:1788540949.463872:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540949.463882:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968424832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788540949.463917:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788540949.470686:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540949.470782:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968424832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6897us (7084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540949.470795:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788540949.470953:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d6828ec700 x1875420968424832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540949.470974:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968424832:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788540949.525348:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:2.0:1788540949.525358:0:6732:0:(genops.c:885:class_export_put()) final put ffff98d7b5261800/103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:2.0:1788540949.525385:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7b5261800/103c367e-0a85-454e-8289-79a7b521f7f2 for lustre-OST0000 00000020:00000080:2.0:1788540949.525452:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7b5266800 for lustre-OST0000 00010000:00010000:3.0:1788540950.103579:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540950.489391:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968424960:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.489502:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540950.489553:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968425472:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.489575:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540950.489599:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788540950.489603:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968425088:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.489620:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540950.489632:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968425600:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.489650:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540950.489671:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968425344:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.489689:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540950.489704:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788540950.489709:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968425216:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.489728:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540950.489756:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425472 00000100:00100000:2.0:1788540950.489764:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425472 00000100:00100000:3.0:1788540950.489776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425088 00000100:00100000:3.0:1788540950.489779:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425088 00000100:00100000:2.0:1788540950.489810:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425216 00000100:00100000:2.0:1788540950.489813:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425216 00000100:00100000:0.0:1788540950.489862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968424960 00000100:00100000:0.0:1788540950.489867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968424960 00000100:00100000:0.0:1788540950.489899:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788540950.489908:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968424960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540950.489963:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968424960:12345-0@lo:400:kworker.0 Request processed in 55us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540950.489971:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788540950.491887:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540950.491908:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968425472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.491983:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968425472:12345-0@lo:400:kworker.0 Request processed in 86us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540950.491991:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788540950.493063:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540950.493092:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788540950.493109:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968425088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540950.493169:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968425088:12345-0@lo:400:kworker.0 Request processed in 69us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540950.493189:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788540950.493219:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425600 00000100:00100000:0.0:1788540950.493228:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425600 00000100:00100000:0.0:1788540950.493283:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425344 00000100:00100000:0.0:1788540950.493288:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425344 00000100:00100000:0.0:1788540950.493312:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788540950.493318:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968425600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540950.493353:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968425600:12345-0@lo:400:kworker.0 Request processed in 36us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540950.493360:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788540950.493372:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540950.493378:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968425344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540950.493445:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968425344:12345-0@lo:400:kworker.0 Request processed in 67us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540950.493451:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788540950.493617:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788540950.493726:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78904ca80 x1875420968425344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540950.493942:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968425344:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.494065:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968425088:0@lo:400:kworker.0 00010000:00080000:3.0:1788540950.494080:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6ea00 x1875420968425600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540950.494089:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968425600:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.494100:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968424960:0@lo:400:kworker.0 00000100:00100000:3.0:1788540950.494111:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968425472:0@lo:400:kworker.0 00000100:00100000:2.0:1788540950.497641:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788540950.497667:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968425216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540950.497844:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968425216:12345-0@lo:400:kworker.0 Request processed in 190us (8112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540950.497851:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788540950.498061:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968425216:0@lo:400:kworker.0 00000100:00100000:0.0:1788540951.006901:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540951.006930:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968425728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788540951.007007:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.007384:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425728 00000100:00100000:3.0:1788540951.007392:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425728 00000100:00100000:3.0:1788540951.007493:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788540951.007504:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968425728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788540951.007540:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540951.007601:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968425728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.007622:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788540951.007709:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb475880 x1875420968425728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540951.007736:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968425728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788540951.128696:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788540952.053761:0:9356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1788540952.167508:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540953.197031:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788540953.201331:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:2.0:1788540953.201340:0:7660:0:(genops.c:885:class_export_put()) final put ffff98d7b5262000/103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:3.0:1788540953.201457:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7b5262000/103c367e-0a85-454e-8289-79a7b521f7f2 for lustre-OST0001 00000020:00000080:3.0:1788540953.201498:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7b5261000 for lustre-OST0001 00010000:00010000:1.0:1788540954.199752:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540954.288929:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540954.289009:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325824 00000100:00100000:1.0:1788540954.289020:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325824 00000100:00100000:1.0:1788540954.289080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 198 00000100:00100000:1.0:1788540954.289091:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2360:x1875420945325824:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540954.289179:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2360:x1875420945325824:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540954.289188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 198 00000100:00100000:2.0:1788540954.308397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540954.308596:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945325952 00000100:00100000:1.0:1788540954.308607:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945325952 00000100:00100000:1.0:1788540954.308679:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1788540954.308690:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945325952:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540954.308764:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945325952:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 76us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540954.308772:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00080000:2.0:1788540954.309020:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540954.594704:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968425856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788540954.594775:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540954.594963:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425856 00000100:00100000:3.0:1788540954.594971:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425856 00000100:00100000:3.0:1788540954.595046:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788540954.595057:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968425856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788540954.595100:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540954.595152:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968425856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540954.595159:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788540954.595898:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788540954.595941:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb476680 x1875420968425856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540954.595981:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968425856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788540955.226186:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788540955.247195:0:9456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:0.0:1788540955.610580:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968426112:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.610673:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540955.610734:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968426624:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.610760:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540955.610796:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788540955.610818:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968425984:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.610852:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540955.610875:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968426496:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.610896:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540955.610923:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968426240:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.610944:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540955.610962:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540955.610967:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968426368:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.610987:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540955.611031:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426112 00000100:00100000:0.0:1788540955.611040:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426112 00000100:00100000:0.0:1788540955.611084:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426496 00000100:00100000:0.0:1788540955.611087:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426496 00000100:00100000:0.0:1788540955.611113:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426240 00000100:00100000:0.0:1788540955.611117:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426240 00000100:00100000:0.0:1788540955.611136:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788540955.611145:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968426112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.611211:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968426112:12345-0@lo:400:kworker.0 Request processed in 65us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540955.611217:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788540955.611235:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788540955.611241:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968426496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.611268:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968426496:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540955.611273:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788540955.611284:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788540955.611290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968426240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.611328:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968426240:12345-0@lo:400:kworker.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540955.611334:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788540955.611354:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426624 00000100:00100000:0.0:1788540955.611358:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426624 00000100:00100000:0.0:1788540955.611382:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426368 00000100:00100000:0.0:1788540955.611384:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426368 00000100:00100000:0.0:1788540955.611401:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788540955.612890:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788540955.612900:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540955.612926:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540955.612946:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968426368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540955.613041:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968426368:12345-0@lo:400:kworker.0 Request processed in 105us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540955.613048:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540955.613080:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968425984 00000100:00100000:2.0:1788540955.613087:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968425984 00000100:00100000:2.0:1788540955.613130:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788540955.613136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968425984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540955.613165:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968425984:12345-0@lo:400:kworker.0 Request processed in 29us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540955.613171:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:2.0:1788540955.617549:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6d500 x1875420968426368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540955.617568:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968426368:0@lo:400:kworker.0 00000100:00100000:2.0:1788540955.617585:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968426240:0@lo:400:kworker.0 00000100:00100000:2.0:1788540955.617628:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968425984:0@lo:400:kworker.0 00000100:00100000:2.0:1788540955.617648:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968426496:0@lo:400:kworker.0 00000100:00100000:2.0:1788540955.617662:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968426112:0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.622275:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968426624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540955.622450:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968426624:12345-0@lo:400:kworker.0 Request processed in 11041us (11687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540955.622462:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788540955.622608:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6fb80 x1875420968426624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540955.622624:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968426624:0@lo:400:kworker.0 00000100:00100000:0.0:1788540956.129305:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540956.129328:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968426752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788540956.129405:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540956.129695:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426752 00000100:00100000:3.0:1788540956.129702:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426752 00000100:00100000:3.0:1788540956.129755:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788540956.129763:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968426752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788540956.129799:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540956.129840:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968426752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540956.129847:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788540956.129925:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb474380 x1875420968426752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540956.129943:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968426752:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788540956.248341:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540957.277490:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788540957.937267:0:9504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 12:55:55 EDT 2026 00010000:00010000:1.0:1788540958.295904:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540959.321569:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540959.376991:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540959.377033:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540959.377079:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326080 00000100:00100000:2.0:1788540959.377091:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326080 00000100:00100000:2.0:1788540959.377157:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:2.0:1788540959.377169:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2360:x1875420945326080:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540959.377243:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2360:x1875420945326080:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 78us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540959.377251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:2.0:1788540959.377288:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326208 00000100:00100000:2.0:1788540959.377291:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326208 00000100:00100000:2.0:1788540959.377326:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:2.0:1788540959.377332:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945326208:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540959.377363:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945326208:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540959.377369:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00080000:2.0:1788540959.377513:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540959.704551:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540959.704573:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968426880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788540959.704651:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540959.704716:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968426880 00000100:00100000:3.0:1788540959.704724:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968426880 00000100:00100000:3.0:1788540959.704796:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788540959.704805:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968426880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788540959.704843:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540959.704892:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968426880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540959.704899:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788540959.704919:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788540959.704951:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb476a00 x1875420968426880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540959.704981:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968426880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788540960.347891:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540960.728781:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968427008:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.728858:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540960.729011:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427008 00000100:00100000:1.0:1788540960.729021:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427008 00000100:00100000:1.0:1788540960.729076:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788540960.729086:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968427008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540960.729441:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968427136:0@lo:400:kworker.0 00000100:00100000:3.0:1788540960.729476:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540960.729607:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427136 00000100:00100000:3.0:1788540960.729612:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427136 00000100:00100000:3.0:1788540960.729643:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788540960.729650:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968427136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540960.729689:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968427136:12345-0@lo:400:kworker.0 Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540960.729696:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788540960.729750:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968427136:0@lo:400:kworker.0 00000100:00100000:1.0:1788540960.730894:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968427008:12345-0@lo:400:kworker.0 Request processed in 1804us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540960.730922:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788540960.731678:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540960.731901:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968427008:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.733547:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968427392:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.733666:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540960.733711:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968427264:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.733737:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540960.733831:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427392 00000100:00100000:3.0:1788540960.733839:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427392 00000100:00100000:3.0:1788540960.733898:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788540960.733908:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968427392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540960.733980:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968427392:12345-0@lo:400:kworker.0 Request processed in 73us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540960.733993:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788540960.734034:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6c380 x1875420968427392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540960.734047:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968427392:0@lo:400:kworker.0 00000100:00100000:1.0:1788540960.734291:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427264 00000100:00100000:1.0:1788540960.734296:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427264 00000100:00100000:1.0:1788540960.734346:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788540960.734354:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968427264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540960.734393:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968427264:12345-0@lo:400:kworker.0 Request processed in 41us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540960.734398:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788540960.734515:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540960.734536:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968427264:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.735270:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968427520:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.735314:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540960.735371:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427520 00000100:00100000:3.0:1788540960.735377:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427520 00000100:00100000:3.0:1788540960.735450:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788540960.735458:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968427520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540960.735846:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968427520:12345-0@lo:400:kworker.0 Request processed in 388us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540960.735854:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788540960.735878:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540960.735897:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968427648:0@lo:400:kworker.0 00000100:00100000:3.0:1788540960.735929:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540960.736032:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427648 00000100:00100000:1.0:1788540960.736036:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427648 00000100:00100000:1.0:1788540960.736081:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788540960.736089:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968427648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540960.736127:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968427648:12345-0@lo:400:kworker.0 Request processed in 39us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540960.736134:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788540960.736249:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788540960.736275:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6ce00 x1875420968427648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540960.736287:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968427648:0@lo:400:kworker.0 00000100:00100000:2.0:1788540960.738074:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968427520:0@lo:400:kworker.0 00000100:00100000:2.0:1788540961.250671:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540961.250696:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968427776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788540961.250769:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540961.251056:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427776 00000100:00100000:3.0:1788540961.251064:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427776 00000100:00100000:3.0:1788540961.251128:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788540961.251138:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968427776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788540961.251188:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540961.251245:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968427776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540961.251252:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788540961.251389:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bb476300 x1875420968427776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540961.251446:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968427776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788540961.372523:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540962.397197:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540963.416395:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540964.440652:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540964.480165:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540964.480235:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540964.480288:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326464 00000100:00100000:2.0:1788540964.480302:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326464 00000100:00100000:3.0:1788540964.480325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326336 00000100:00100000:3.0:1788540964.480332:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326336 00000100:00100000:2.0:1788540964.480437:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1788540964.480440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:3.0:1788540964.480456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2359:x1875420945326336:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540964.480456:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945326464:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540964.480558:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945326464:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 110us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540964.480567:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00080000:0.0:1788540964.480706:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540964.484732:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2359:x1875420945326336:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 3949us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540964.484752:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:3.0:1788540964.840104:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968427904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788540964.840176:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540964.840606:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968427904 00000100:00100000:1.0:1788540964.840616:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968427904 00000100:00100000:1.0:1788540964.840682:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788540964.840692:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968427904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788540964.840728:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540964.840778:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968427904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540964.840798:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788540964.840838:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bf680e00 x1875420968427904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540964.840867:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968427904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788540964.847124:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788540965.466826:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540965.849820:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.851055:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968428032:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.851185:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540965.851248:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968428544:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.851271:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540965.851338:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.851363:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540965.851384:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540965.851389:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968428416:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.851429:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540965.851460:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428032 00000100:00100000:0.0:1788540965.851468:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428032 00000100:00100000:0.0:1788540965.851523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788540965.851532:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.853272:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968428032:12345-0@lo:400:kworker.0 Request processed in 1727us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540965.853291:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788540965.853352:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428544 00000100:00100000:0.0:1788540965.853360:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428544 00000100:00100000:0.0:1788540965.853434:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428288 00000100:00100000:0.0:1788540965.853438:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428288 00000100:00100000:0.0:1788540965.853459:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788540965.853467:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968428544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.853512:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968428544:12345-0@lo:400:kworker.0 Request processed in 46us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540965.853519:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788540965.853531:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788540965.853537:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540965.853798:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968428032:0@lo:400:kworker.0 00000100:00100000:3.0:1788540965.853819:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968428544:0@lo:400:kworker.0 00000100:00100000:2.0:1788540965.859707:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540965.859790:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968428672:0@lo:400:kworker.0 00000100:00100000:2.0:1788540965.859867:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540965.860404:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428416 00000100:00100000:3.0:1788540965.860446:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428416 00000100:00100000:3.0:1788540965.860509:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428672 00000100:00100000:3.0:1788540965.860513:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428672 00000100:00100000:3.0:1788540965.860548:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788540965.860574:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968428416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540965.860661:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968428416:12345-0@lo:400:kworker.0 Request processed in 91us (9230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540965.860670:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788540965.860699:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788540965.860707:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968428672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540965.860743:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968428672:12345-0@lo:400:kworker.0 Request processed in 38us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540965.860750:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788540965.861255:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bf683480 x1875420968428672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540965.861272:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968428672:0@lo:400:kworker.0 00000100:00080000:2.0:1788540965.861560:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788540965.861568:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540965.861596:0:5852:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788540965.861607:0:5852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788540965.862485:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788540965.862498:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428160 00000100:00100000:3.0:1788540965.862506:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428160 00000100:00100000:3.0:1788540965.862543:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788540965.862626:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788540965.862639:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968428160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540965.862730:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968428160:12345-0@lo:400:kworker.0 Request processed in 94us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540965.862739:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788540965.862787:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.864354:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968428288:12345-0@lo:400:kworker.0 Request processed in 10811us (12983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540965.864367:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788540965.864444:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bf683b80 x1875420968428416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540965.864467:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968428416:0@lo:400:kworker.0 00000100:00100000:0.0:1788540965.864481:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968428288:0@lo:400:kworker.0 00000100:00100000:1.0:1788540966.360025:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968428800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788540966.360130:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540966.360286:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428800 00000100:00100000:0.0:1788540966.360299:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428800 00000100:00100000:0.0:1788540966.360378:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788540966.360391:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968428800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788540966.360480:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788540966.360542:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968428800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540966.360561:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788540966.360771:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6d500 x1875420968428800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540966.360792:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968428800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788540966.488681:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540967.517051:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540968.541458:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540969.564888:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540969.598540:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540969.598578:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540969.602223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326592 00000100:00100000:2.0:1788540969.602239:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326592 00000100:00100000:2.0:1788540969.602308:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:2.0:1788540969.602318:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945326592:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540969.602402:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945326592:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 85us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540969.602424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:3.0:1788540969.609587:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326720 00000100:00100000:3.0:1788540969.609605:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326720 00000100:00100000:3.0:1788540969.609686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1788540969.609699:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945326720:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540969.609916:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945326720:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 220us (11336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540969.609925:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00080000:2.0:1788540969.610440:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540969.952051:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540969.952076:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968428928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788540969.952153:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540969.952224:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968428928 00000100:00100000:2.0:1788540969.952231:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968428928 00000100:00100000:2.0:1788540969.952286:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788540969.952296:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968428928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788540969.952332:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540969.952374:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968428928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540969.952381:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788540969.952447:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788540969.952478:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bf683480 x1875420968428928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540969.952496:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968428928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788540970.584075:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540970.979802:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968429312:0@lo:400:kworker.0 00000100:00100000:0.0:1788540970.979883:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540970.979946:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540970.979953:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968429440:0@lo:400:kworker.0 00000100:00100000:0.0:1788540970.979980:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540970.980014:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429312 00000100:00100000:3.0:1788540970.980127:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968429184:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980163:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540970.980206:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968429696:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980229:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540970.980248:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788540970.980254:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968429056:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980281:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540970.980304:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968429568:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980326:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540970.980353:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429440 00000100:00100000:3.0:1788540970.980360:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429440 00000100:00100000:3.0:1788540970.980401:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429696 00000100:00100000:3.0:1788540970.980404:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429696 00000100:00100000:3.0:1788540970.980458:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788540970.980466:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968429440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980531:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968429440:12345-0@lo:400:kworker.0 Request processed in 65us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540970.980538:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788540970.980555:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788540970.980561:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968429696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980596:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968429696:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540970.980601:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788540970.980621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429056 00000100:00100000:3.0:1788540970.980625:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429056 00000100:00100000:3.0:1788540970.980649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788540970.980656:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968429056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980696:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968429056:12345-0@lo:400:kworker.0 Request processed in 40us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540970.980702:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788540970.980726:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429184 00000100:00100000:3.0:1788540970.980730:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429184 00000100:00100000:3.0:1788540970.980750:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429568 00000100:00100000:3.0:1788540970.980753:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429568 00000100:00100000:3.0:1788540970.980765:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788540970.980771:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968429184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980797:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968429184:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540970.980803:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788540970.980813:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788540970.980818:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968429568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980869:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968429568:12345-0@lo:400:kworker.0 Request processed in 50us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540970.980876:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788540970.980894:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788540970.980898:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788540970.980926:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6fb80 x1875420968429440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540970.980939:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968429440:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980971:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968429056:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980982:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968429568:0@lo:400:kworker.0 00000100:00100000:3.0:1788540970.980992:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968429184:0@lo:400:kworker.0 00010000:00080000:3.0:1788540970.981011:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6f100 x1875420968429696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540970.981035:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788540970.982118:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429312 00000100:00100000:0.0:1788540970.982176:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788540970.982185:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540970.982296:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968429312:12345-0@lo:400:kworker.0 Request processed in 112us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540970.982312:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788540970.982429:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540970.982459:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968429312:0@lo:400:kworker.0 00000100:00100000:1.0:1788540971.480742:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788540971.480766:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968429824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788540971.480836:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540971.481277:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429824 00000100:00100000:2.0:1788540971.481285:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429824 00000100:00100000:2.0:1788540971.481342:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788540971.481353:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968429824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788540971.481388:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540971.481468:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968429824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540971.481476:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788540971.481534:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682927b80 x1875420968429824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540971.481553:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968429824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788540971.611364:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540972.631786:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540973.655575:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540974.685043:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540974.717160:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540974.717221:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540974.717324:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326848 00000100:00100000:0.0:1788540974.717338:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326848 00000100:00100000:0.0:1788540974.717464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:0.0:1788540974.717477:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945326848:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540974.717577:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945326848:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.717585:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:3.0:1788540974.718132:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945326976 00000100:00100000:3.0:1788540974.718139:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945326976 00000100:00100000:3.0:1788540974.718246:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:3.0:1788540974.718257:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945326976:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540974.718306:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945326976:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 52us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.718313:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00080000:2.0:1788540974.725792:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540975.065283:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968429952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788540975.065395:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540975.065620:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968429952 00000100:00100000:0.0:1788540975.065630:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968429952 00000100:00100000:0.0:1788540975.065716:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788540975.065730:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968429952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788540975.065773:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788540975.065841:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968429952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540975.065849:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788540975.065901:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6ea00 x1875420968429952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540975.065924:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968429952:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788540975.066092:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788540975.705110:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540976.087638:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968430336:0@lo:400:kworker.0 00000100:00100000:1.0:1788540976.087723:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540976.087758:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968430464:0@lo:400:kworker.0 00000100:00100000:1.0:1788540976.087795:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430336 00000100:00100000:0.0:1788540976.087817:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540976.087829:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430336 00000100:00100000:1.0:1788540976.087888:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788540976.087898:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968430336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540976.087950:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968430336:12345-0@lo:400:kworker.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540976.087957:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788540976.088007:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968430336:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088164:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968430208:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088195:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540976.088221:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968430720:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088240:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540976.088256:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788540976.088261:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968430080:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088283:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540976.088310:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968430592:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088329:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540976.088491:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430208 00000100:00100000:2.0:1788540976.088496:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430208 00000100:00100000:2.0:1788540976.088517:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430592 00000100:00100000:2.0:1788540976.088520:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430592 00000100:00100000:2.0:1788540976.088536:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788540976.088543:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968430208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088579:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968430208:12345-0@lo:400:kworker.0 Request processed in 37us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540976.088585:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788540976.088599:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788540976.088605:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088629:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968430592:12345-0@lo:400:kworker.0 Request processed in 24us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540976.088634:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788540976.088677:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968430592:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.088687:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968430208:0@lo:400:kworker.0 00000100:00100000:3.0:1788540976.089461:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430464 00000100:00100000:3.0:1788540976.089467:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430464 00000100:00100000:3.0:1788540976.089498:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430720 00000100:00100000:3.0:1788540976.089501:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430720 00000100:00100000:3.0:1788540976.089520:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788540976.089527:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968430464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540976.089586:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968430464:12345-0@lo:400:kworker.0 Request processed in 58us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540976.089592:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788540976.089616:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788540976.089621:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968430720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540976.089731:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968430720:12345-0@lo:400:kworker.0 Request processed in 109us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540976.089738:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788540976.089755:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788540976.089760:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540976.089774:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430080 00000100:00100000:3.0:1788540976.089777:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430080 00000100:00100000:3.0:1788540976.089813:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788540976.089821:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968430080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540976.089852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968430080:12345-0@lo:400:kworker.0 Request processed in 33us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540976.089858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788540976.089905:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968430080:0@lo:400:kworker.0 00010000:00080000:3.0:1788540976.089919:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6fb80 x1875420968430720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540976.089928:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968430720:0@lo:400:kworker.0 00010000:00080000:3.0:1788540976.089961:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6ce00 x1875420968430464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540976.089969:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968430464:0@lo:400:kworker.0 00000100:00100000:2.0:1788540976.599743:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968430848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788540976.599827:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540976.600034:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430848 00000100:00100000:0.0:1788540976.600056:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430848 00000100:00100000:0.0:1788540976.600120:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788540976.600130:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968430848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788540976.600169:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788540976.600228:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968430848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540976.600236:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788540976.600316:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682924a80 x1875420968430848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540976.600334:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968430848:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788540976.728002:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540977.754760:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788540978.321150:0:10137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:56:16 (1788540976) === 00010000:00010000:3.0:1788540978.777146:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540978.959486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540978.959590:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327104 00000100:00100000:2.0:1788540978.959605:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327104 00000100:00100000:2.0:1788540978.959692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 208 00000100:00100000:2.0:1788540978.959705:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:8123:x1875420945327104:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788540978.959940:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540978.959969:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1aae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1518 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540978.960008:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1aae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1518 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540978.960023:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1aae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1518 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540978.960033:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fda00, rc 0) 00000100:00100000:2.0:1788540978.960116:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8123:x1875420945327104:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 414us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540978.960124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 208 00000100:00100000:0.0:1788540978.968532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540978.969969:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327232 00000100:00100000:3.0:1788540978.970009:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327232 00000100:00100000:3.0:1788540978.970099:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 209 00000100:00100000:3.0:1788540978.970113:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8123:x1875420945327232:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788540978.970594:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8123:x1875420945327232:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 482us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540978.970605:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 209 00000100:00100000:1.0:1788540978.977842:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540978.977985:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327360 00000100:00100000:2.0:1788540978.978002:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327360 00000100:00100000:2.0:1788540978.978089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:2.0:1788540978.978104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8123:x1875420945327360:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788540978.978459:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8123:x1875420945327360:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 357us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540978.978469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:1.0:1788540978.990608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540978.991104:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327488 00000100:00100000:3.0:1788540978.991118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327488 00000100:00100000:3.0:1788540978.991181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 211 00000100:00100000:3.0:1788540978.991193:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8126:x1875420945327488:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788540978.993287:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8126:x1875420945327488:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 2086us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540978.993301:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 211 00000100:00100000:0.0:1788540979.025165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540979.029801:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327616 00000100:00100000:2.0:1788540979.029824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327616 00000100:00100000:2.0:1788540979.029921:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:2.0:1788540979.029935:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8126:x1875420945327616:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788540979.030353:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8126:x1875420945327616:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 420us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.030363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:1.0:1788540979.041075:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540979.041301:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327744 00000100:00100000:3.0:1788540979.041315:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327744 00000100:00100000:3.0:1788540979.041385:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:3.0:1788540979.041398:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:8123:x1875420945327744:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788540979.041465:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540979.041502:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1aaf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1542 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540979.041543:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1aaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1542 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540979.041563:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1aaf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1542 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540979.041615:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd200, rc 0) 00000100:00100000:3.0:1788540979.041691:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:8123:x1875420945327744:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 296us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.041699:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:1.0:1788540979.061849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540979.061971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945327872 00000100:00100000:2.0:1788540979.061987:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945327872 00000100:00100000:2.0:1788540979.062063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:2.0:1788540979.062075:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:8123:x1875420945327872:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788540979.062117:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788540979.062153:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788540979.062157:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788540979.062161:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788540979.062164:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788540979.069847:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:8123:x1875420945327872:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 7755us (7995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.069867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:1.0:1788540979.079582:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540979.079923:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328000 00000100:00100000:3.0:1788540979.079938:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328000 00000100:00100000:3.0:1788540979.080026:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:3.0:1788540979.080040:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:8123:x1875420945328000:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788540979.080065:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540979.080089:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1549 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540979.080132:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540979.080146:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540979.080158:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bdc00, rc 0) 00000100:00100000:3.0:1788540979.080286:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8123:x1875420945328000:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 248us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.080294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:1.0:1788540979.083485:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540979.083647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328128 00000100:00100000:2.0:1788540979.083660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328128 00000100:00100000:2.0:1788540979.083826:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:2.0:1788540979.083842:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8123:x1875420945328128:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788540979.085213:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8123:x1875420945328128:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 1365us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.085226:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:1.0:1788540979.091492:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540979.091721:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328256 00000100:00100000:0.0:1788540979.091735:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328256 00000100:00100000:0.0:1788540979.091812:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:0.0:1788540979.091823:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8123:x1875420945328256:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788540979.092113:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8123:x1875420945328256:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 292us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540979.092122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:1.0:1788540979.096475:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540979.098180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328384 00000100:00100000:2.0:1788540979.098199:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328384 00000100:00100000:2.0:1788540979.098288:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:2.0:1788540979.098301:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8129:x1875420945328384:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788540979.098905:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8129:x1875420945328384:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 604us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.098915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:1.0:1788540979.109831:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540979.110658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328512 00000100:00100000:3.0:1788540979.110674:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328512 00000100:00100000:3.0:1788540979.110758:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:3.0:1788540979.110771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8129:x1875420945328512:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788540979.112794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:8129:x1875420945328512:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 2004us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.112811:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:1.0:1788540979.124702:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540979.125240:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328640 00000100:00100000:2.0:1788540979.125255:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328640 00000100:00100000:2.0:1788540979.125321:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1788540979.125333:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1875420945328640:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788540979.125376:0:9724:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d9af4bce-162d-4333-8def-621043259a82@192.168.202.59@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788540979.125538:0:9724:0:(genops.c:1385:class_connect()) connect: client d9af4bce-162d-4333-8def-621043259a82, cookie 0xc9a6a13d3cd1aafe 00000004:00100000:2.0:1788540979.125646:0:9724:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788540979.126280:0:9724:0:(import.c:65:import_set_state_nolock()) ffff98d7b5262000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540979.127102:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+6:2357:x1875420945328640:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 1765us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.127114:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1788540979.142813:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540979.143516:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329024 00000100:00100000:3.0:1788540979.143531:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329024 00000100:00100000:3.0:1788540979.143633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:3.0:1788540979.143646:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2361:x1875420945329024:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540979.143755:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2361:x1875420945329024:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 111us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.143763:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00080000:0.0:1788540979.144170:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540979.152542:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540979.153211:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540979.153440:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328768 00000100:00100000:1.0:1788540979.153456:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328768 00000100:00080000:0.0:1788540979.153852:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788540979.154019:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945328896 00000100:00100000:1.0:1788540979.154025:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945328896 00000100:00100000:3.0:1788540979.163467:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1788540979.163509:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+7:0:x1875420945328768:12345-192.168.202.59@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788540979.163727:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1788540979.163741:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+7:8123:x1875420945328896:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788540979.163791:0:9724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788540979.163928:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+7:8123:x1875420945328896:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 190us (10719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.163936:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000004:00000024:3.0:1788540979.166821:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788540979.166959:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+6:0:x1875420945328768:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 3454us (14415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.166972:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1788540979.170768:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540979.171615:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329152 00000100:00100000:0.0:1788540979.171632:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329152 00000100:00100000:0.0:1788540979.171721:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788540979.171742:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+6:8123:x1875420945329152:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788540979.171888:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+6:8123:x1875420945329152:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 157us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540979.171897:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788540979.176310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540979.176357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540979.176395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540979.176650:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329536 00000100:00100000:3.0:1788540979.176664:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329536 00000100:00100000:3.0:1788540979.176741:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:3.0:1788540979.176754:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9af4bce-162d-4333-8def-621043259a82+6:8123:x1875420945329536:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788540979.176871:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788540979.176979:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d9af4bce-162d-4333-8def-621043259a82+6:8123:x1875420945329536:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 227us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.176987:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1788540979.181620:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329280 00000100:00100000:2.0:1788540979.181646:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329280 00000100:00100000:2.0:1788540979.181732:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329408 00000100:00100000:2.0:1788540979.181753:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329408 00000100:00100000:2.0:1788540979.181808:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1788540979.181820:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875420945329280:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788540979.181866:0:6704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d9af4bce-162d-4333-8def-621043259a82@192.168.202.59@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788540979.181912:0:6704:0:(genops.c:1385:class_connect()) connect: client d9af4bce-162d-4333-8def-621043259a82, cookie 0xc9a6a13d3cd1ab05 00002000:00100000:2.0:1788540979.181929:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d9af4bce-162d-4333-8def-621043259a82/ffff98d7b5263800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788540979.182120:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1788540979.182128:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875420945329408:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788540979.182148:0:9248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d9af4bce-162d-4333-8def-621043259a82@192.168.202.59@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1788540979.182170:0:9248:0:(genops.c:1385:class_connect()) connect: client d9af4bce-162d-4333-8def-621043259a82, cookie 0xc9a6a13d3cd1ab0c 00002000:00100000:3.0:1788540979.182176:0:9248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d9af4bce-162d-4333-8def-621043259a82/ffff98d681ffc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788540979.182204:0:9248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788540979.182565:0:9248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788540979.182626:0:9248:0:(import.c:65:import_set_state_nolock()) ffff98d681ffe000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540979.182721:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d9af4bce-162d-4333-8def-621043259a82+6:2357:x1875420945329408:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 591us (6323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.182730:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00002000:00100000:2.0:1788540979.184759:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788540979.185206:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788540979.185348:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98d7b5264000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540979.185532:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d9af4bce-162d-4333-8def-621043259a82+6:2357:x1875420945329280:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 3708us (9169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540979.185544:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00010000:00010000:0.0:1788540979.799643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540980.195206:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788540980.197358:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540980.197454:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968430976 00000100:00100000:1.0:1788540980.197464:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968430976 00000100:00100000:1.0:1788540980.197528:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788540980.197538:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968430976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788540980.197567:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540980.197643:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968430976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540980.197662:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788540980.197687:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788540980.197779:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682926680 x1875420968430976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540980.197800:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968430976:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788540980.278338:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d9af4bce-162d-4333-8def-621043259a82 00010000:00010000:2.0:1788540980.825675:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540981.207684:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968431232:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.207769:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540981.207832:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968431744:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.207858:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540981.207891:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788540981.207898:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968431104:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.207937:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540981.207960:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968431616:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.207981:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540981.208008:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968431360:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208028:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540981.208048:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540981.208054:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968431488:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208074:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540981.208104:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431232 00000100:00100000:0.0:1788540981.208112:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431232 00000100:00100000:0.0:1788540981.208156:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431616 00000100:00100000:0.0:1788540981.208159:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431616 00000100:00100000:0.0:1788540981.208180:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431360 00000100:00100000:0.0:1788540981.208183:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431360 00000100:00100000:0.0:1788540981.208198:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788540981.208206:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968431232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208265:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968431232:12345-0@lo:400:kworker.0 Request processed in 59us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.208280:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788540981.208296:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788540981.208303:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208335:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968431616:12345-0@lo:400:kworker.0 Request processed in 34us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.208340:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788540981.208351:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788540981.208356:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968431360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208383:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968431360:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.208388:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788540981.208436:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431744 00000100:00100000:0.0:1788540981.208441:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431744 00000100:00100000:0.0:1788540981.208466:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431488 00000100:00100000:0.0:1788540981.208469:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431488 00000100:00100000:0.0:1788540981.208485:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540981.208491:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968431744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208523:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968431744:12345-0@lo:400:kworker.0 Request processed in 32us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.208529:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540981.208539:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788540981.208544:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968431488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208569:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968431488:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.208574:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788540981.208600:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431104 00000100:00100000:0.0:1788540981.208603:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431104 00000100:00100000:0.0:1788540981.208627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788540981.208633:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968431104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208662:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968431104:12345-0@lo:400:kworker.0 Request processed in 30us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.208668:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:0.0:1788540981.208705:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540981.208709:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788540981.208745:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9e680 x1875420968431488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540981.208770:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968431488:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208784:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968431360:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208809:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968431104:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208818:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968431616:0@lo:400:kworker.0 00000100:00100000:0.0:1788540981.208826:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968431232:0@lo:400:kworker.0 00010000:00080000:0.0:1788540981.208834:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9f100 x1875420968431744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540981.208842:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968431744:0@lo:400:kworker.0 00000100:00100000:3.0:1788540981.720387:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788540981.720441:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968431872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788540981.720516:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540981.721097:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968431872 00000100:00100000:1.0:1788540981.721108:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968431872 00000100:00100000:1.0:1788540981.721171:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788540981.721183:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968431872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788540981.721228:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540981.721314:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968431872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540981.721322:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788540981.721356:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682924380 x1875420968431872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540981.721379:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968431872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788540981.848619:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540982.871837:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788540983.808553:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d9af4bce-162d-4333-8def-621043259a82 00000001:00100000:1.0:1788540983.813402:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d9af4bce-162d-4333-8def-621043259a82 00010000:00010000:0.0:1788540983.895572:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540984.445996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540984.446385:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329664 00000100:00100000:3.0:1788540984.446397:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329664 00000100:00100000:3.0:1788540984.446473:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:3.0:1788540984.446483:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945329664:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540984.453513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945329664:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 7018us (7514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540984.453528:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:3.0:1788540984.454921:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540984.454972:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788540984.454994:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540984.455057:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330176 00000100:00100000:0.0:1788540984.455066:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330176 00000100:00100000:3.0:1788540984.455352:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788540984.455442:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329920 00000100:00100000:1.0:1788540984.455447:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329920 00000100:00100000:2.0:1788540984.465316:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330048 00000100:00100000:2.0:1788540984.465333:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330048 00000100:00100000:2.0:1788540984.465472:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945329792 00000100:00100000:2.0:1788540984.465476:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945329792 00000100:00100000:1.0:1788540984.465827:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:1.0:1788540984.465838:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945329920:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540984.465919:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945329920:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 83us (11004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540984.465926:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:2.0:1788540984.466231:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:2.0:1788540984.466253:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2361:x1875420945329792:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788540984.466285:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2361:x1875420945329792:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 33us (11289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540984.466291:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:3.0:1788540984.474285:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:3.0:1788540984.474301:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945330176:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540984.474375:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945330176:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 78us (19402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540984.474383:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:3.0:1788540984.474399:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1788540984.474425:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945330048:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540984.474450:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945330048:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 45us (19099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540984.474456:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00080000:2.0:1788540984.477582:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788540984.477593:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788540984.477595:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788540984.919560:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788540984.991342:0:10333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788540985.303755:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540985.303778:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968432000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788540985.303842:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540985.304802:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432000 00000100:00100000:1.0:1788540985.304812:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432000 00000100:00080000:2.0:1788540985.304857:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788540985.304867:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788540985.304881:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968432000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788540985.304917:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540985.304989:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968432000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540985.304996:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788540985.305012:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682927100 x1875420968432000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540985.305032:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968432000:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788540985.946915:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540986.327988:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968432256:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328062:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540986.328112:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968432768:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328140:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540986.328174:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788540986.328181:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968432128:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328215:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540986.328237:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968432640:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328259:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540986.328286:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968432384:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328316:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540986.328348:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540986.328353:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328373:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540986.328405:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432256 00000100:00100000:3.0:1788540986.328428:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432256 00000100:00100000:3.0:1788540986.328470:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432640 00000100:00100000:3.0:1788540986.328474:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432640 00000100:00100000:3.0:1788540986.328493:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432384 00000100:00100000:3.0:1788540986.328496:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432384 00000100:00100000:3.0:1788540986.328510:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788540986.328519:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968432256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328569:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968432256:12345-0@lo:400:kworker.0 Request processed in 51us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540986.328577:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788540986.328594:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788540986.328600:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968432640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328624:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968432640:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540986.328630:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788540986.328638:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788540986.328643:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968432384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328667:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968432384:12345-0@lo:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540986.328672:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788540986.328687:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432768 00000100:00100000:3.0:1788540986.328690:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432768 00000100:00100000:3.0:1788540986.328732:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432512 00000100:00100000:3.0:1788540986.328736:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432512 00000100:00100000:3.0:1788540986.328751:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540986.328755:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968432768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328784:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968432768:12345-0@lo:400:kworker.0 Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540986.328791:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540986.328801:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788540986.328806:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968432512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328832:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968432512:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540986.328837:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788540986.328855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432128 00000100:00100000:3.0:1788540986.328858:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432128 00000100:00100000:3.0:1788540986.328879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788540986.328885:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968432128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.328913:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968432128:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540986.328918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:3.0:1788540986.328951:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788540986.328956:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788540986.328991:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7831b2d80 x1875420968432512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540986.329005:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.329017:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968432384:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.329045:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968432128:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.329064:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968432640:0@lo:400:kworker.0 00000100:00100000:3.0:1788540986.329074:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968432256:0@lo:400:kworker.0 00010000:00080000:3.0:1788540986.329084:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7831b0380 x1875420968432768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540986.329093:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968432768:0@lo:400:kworker.0 00000100:00100000:0.0:1788540986.839556:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968432896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788540986.839630:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540986.839730:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968432896 00000100:00100000:0.0:1788540986.839738:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968432896 00000100:00100000:0.0:1788540986.839792:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540986.839804:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968432896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788540986.839845:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788540986.839899:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968432896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540986.839907:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788540986.841333:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9f100 x1875420968432896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540986.841362:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968432896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788540986.975257:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540988.002991:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540989.020652:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540989.564532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540989.564660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330304 00000100:00100000:0.0:1788540989.564670:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330304 00000100:00100000:0.0:1788540989.564742:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:0.0:1788540989.564754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945330304:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540989.564868:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945330304:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 115us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.564876:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:2.0:1788540989.571018:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540989.571068:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540989.571109:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540989.571153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540989.571291:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330688 00000100:00100000:0.0:1788540989.571302:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330688 00000100:00100000:0.0:1788540989.571383:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330816 00000100:00100000:0.0:1788540989.571387:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330816 00000100:00100000:0.0:1788540989.571451:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1788540989.571462:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945330688:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540989.571539:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945330688:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 79us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.571547:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1788540989.571566:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:0.0:1788540989.571572:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2359:x1875420945330816:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540989.571613:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb5bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2359:x1875420945330816:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.571619:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1788540989.571744:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330432 00000100:00100000:1.0:1788540989.571750:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330432 00000100:00100000:1.0:1788540989.571787:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330560 00000100:00100000:1.0:1788540989.571791:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330560 00000100:00100000:1.0:1788540989.571819:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:1.0:1788540989.571828:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945330432:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540989.571840:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:1.0:1788540989.571864:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945330432:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 37us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.571868:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2359:x1875420945330560:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788540989.571888:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:0.0:1788540989.571904:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2359:x1875420945330560:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 54us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.571913:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00080000:2.0:1788540989.571990:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788540989.571997:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788540989.571999:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788540990.045960:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540990.431953:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968433024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788540990.432020:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540990.432102:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433024 00000100:00100000:2.0:1788540990.432110:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433024 00000100:00100000:2.0:1788540990.432166:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788540990.432175:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968433024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788540990.432224:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788540990.432909:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968433024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 732us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540990.432918:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788540990.432945:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788540990.434457:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bf680e00 x1875420968433024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540990.434487:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968433024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788540991.068865:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540991.455555:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968433408:0@lo:400:kworker.0 00000100:00100000:3.0:1788540991.455949:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968433280:0@lo:400:kworker.0 00000100:00100000:3.0:1788540991.456009:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.456075:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788540991.459935:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433280 00000100:00100000:3.0:1788540991.459950:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433280 00000100:00100000:3.0:1788540991.460014:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788540991.460025:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968433280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540991.465966:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540991.466748:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433152 00000100:00100000:1.0:1788540991.466760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433152 00000100:00100000:1.0:1788540991.466823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788540991.466843:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968433152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788540991.466919:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968433152:12345-0@lo:400:kworker.0 Request processed in 79us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540991.466927:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788540991.467093:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540991.467209:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968433536:0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467243:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540991.467280:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433536 00000100:00100000:0.0:1788540991.467284:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433536 00000100:00100000:0.0:1788540991.467315:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788540991.467322:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968433536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467359:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968433536:12345-0@lo:400:kworker.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540991.467365:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788540991.467403:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9ce00 x1875420968433536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540991.467434:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968433536:0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467488:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968433792:0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467511:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540991.467530:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788540991.467535:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968433664:0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467558:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540991.467597:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433792 00000100:00100000:0.0:1788540991.467601:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433792 00000100:00100000:0.0:1788540991.467636:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788540991.467643:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968433792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467689:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968433792:12345-0@lo:400:kworker.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540991.467695:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788540991.467712:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433408 00000100:00100000:0.0:1788540991.467715:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433408 00000100:00100000:0.0:1788540991.467744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433664 00000100:00100000:0.0:1788540991.467747:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433664 00000100:00100000:0.0:1788540991.467762:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788540991.467768:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467802:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968433408:12345-0@lo:400:kworker.0 Request processed in 35us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540991.467808:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788540991.467819:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788540991.467824:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968433664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467863:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968433664:12345-0@lo:400:kworker.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540991.467869:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788540991.467883:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788540991.467888:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788540991.467908:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968433408:0@lo:400:kworker.0 00000100:00100000:0.0:1788540991.467934:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968433664:0@lo:400:kworker.0 00010000:00080000:0.0:1788540991.467943:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9c380 x1875420968433792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540991.467953:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968433792:0@lo:400:kworker.0 00000100:00100000:1.0:1788540991.468151:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788540991.469945:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968433280:12345-0@lo:400:kworker.0 Request processed in 9915us (13928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540991.469959:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788540991.469971:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968433280:0@lo:400:kworker.0 00000100:00100000:1.0:1788540991.959634:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968433920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788540991.959732:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540991.959838:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968433920 00000100:00100000:3.0:1788540991.959846:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968433920 00000100:00100000:3.0:1788540991.959895:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788540991.959905:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968433920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788540991.959938:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788540991.960984:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968433920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1076us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540991.960994:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788540991.964713:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9d880 x1875420968433920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540991.964743:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968433920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788540992.091103:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540993.112589:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540994.135683:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540994.691323:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540994.691361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540994.691388:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540994.691427:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540994.691472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540994.692031:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331200 00000100:00100000:0.0:1788540994.692043:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331200 00000100:00100000:0.0:1788540994.692096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331072 00000100:00100000:0.0:1788540994.692099:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331072 00000100:00100000:0.0:1788540994.692121:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:0.0:1788540994.692130:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945331200:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540994.692214:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945331200:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 84us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540994.692222:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:0.0:1788540994.692241:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:0.0:1788540994.692248:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945331072:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540994.692273:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945331072:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540994.692279:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:0.0:1788540994.692301:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331456 00000100:00100000:0.0:1788540994.692304:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331456 00000100:00100000:0.0:1788540994.692329:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331328 00000100:00100000:0.0:1788540994.692331:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331328 00000100:00100000:0.0:1788540994.692350:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1788540994.692356:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945331456:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540994.692382:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945331456:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540994.692387:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1788540994.692398:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1788540994.692403:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945331328:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540994.692455:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945331328:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 52us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540994.692461:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00080000:0.0:1788540994.692492:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788540994.692496:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540994.692499:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540994.693120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945330944 00000100:00100000:3.0:1788540994.693127:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945330944 00000100:00100000:3.0:1788540994.693165:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:3.0:1788540994.693173:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945330944:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540994.693212:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945330944:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 40us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540994.693218:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 225 00010000:00010000:0.0:1788540995.162869:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540995.548662:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968434048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788540995.548781:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540995.553641:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434048 00000100:00100000:1.0:1788540995.553656:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434048 00000100:00100000:1.0:1788540995.553727:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788540995.553749:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968434048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788540995.553789:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540995.553857:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968434048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (5075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540995.553864:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788540995.553909:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9c380 x1875420968434048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540995.553928:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968434048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788540995.554274:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788540996.183636:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540996.568640:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968434432:0@lo:400:kworker.0 00000100:00100000:0.0:1788540996.568716:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540996.568775:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540996.568793:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788540996.568822:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540996.568864:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434432 00000100:00100000:0.0:1788540996.568873:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434432 00000100:00100000:0.0:1788540996.568929:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788540996.568938:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968434432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540996.568991:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968434432:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540996.568999:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788540996.569025:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434560 00000100:00100000:0.0:1788540996.569028:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434560 00000100:00100000:0.0:1788540996.569054:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788540996.569060:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968434560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540996.569090:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968434560:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540996.569096:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788540996.569110:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788540996.569141:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9f800 x1875420968434560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540996.569155:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788540996.569165:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968434432:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.569498:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968434304:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.569532:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540996.569558:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968434816:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.569579:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540996.569601:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788540996.569606:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968434176:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.569646:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540996.569670:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968434688:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.569690:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540996.569716:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434816 00000100:00100000:3.0:1788540996.569720:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434816 00000100:00100000:3.0:1788540996.569760:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788540996.569767:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968434816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.569904:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968434816:12345-0@lo:400:kworker.0 Request processed in 137us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540996.569913:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788540996.569933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434176 00000100:00100000:3.0:1788540996.569937:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434176 00000100:00100000:3.0:1788540996.569961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788540996.569976:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.570006:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968434176:12345-0@lo:400:kworker.0 Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540996.570013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788540996.570039:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434304 00000100:00100000:3.0:1788540996.570042:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434304 00000100:00100000:3.0:1788540996.570064:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434688 00000100:00100000:3.0:1788540996.570068:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434688 00000100:00100000:3.0:1788540996.570089:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788540996.570095:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968434304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.570124:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968434304:12345-0@lo:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540996.570131:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788540996.570141:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788540996.570146:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968434688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.570171:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968434688:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540996.570176:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788540996.570196:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788540996.570199:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788540996.570219:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968434176:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.570232:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968434688:0@lo:400:kworker.0 00000100:00100000:3.0:1788540996.570241:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968434304:0@lo:400:kworker.0 00010000:00080000:3.0:1788540996.570252:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9c380 x1875420968434816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540996.570547:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968434816:0@lo:400:kworker.0 00000100:00100000:2.0:1788540997.079703:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540997.079798:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968434944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788540997.079890:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540997.080032:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968434944 00000100:00100000:1.0:1788540997.080039:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968434944 00000100:00100000:1.0:1788540997.080128:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788540997.080139:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968434944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788540997.080176:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788540997.080250:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968434944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540997.080258:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788540997.080394:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9e680 x1875420968434944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540997.080447:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968434944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788540997.207885:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540998.231655:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540999.256666:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540999.807091:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540999.807180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540999.807209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540999.807234:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788540999.807312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788540999.807705:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331968 00000100:00100000:0.0:1788540999.807716:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331968 00000100:00100000:0.0:1788540999.807790:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332096 00000100:00100000:0.0:1788540999.807793:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332096 00000100:00100000:0.0:1788540999.807819:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1788540999.807828:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2357:x1875420945331968:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:0.0:1788540999.807859:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1ab05 00000100:00080000:0.0:1788540999.807868:0:6705:0:(import.c:65:import_set_state_nolock()) ffff98d7b5264000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788540999.807918:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788540999.808164:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331584 00000100:00100000:3.0:1788540999.808170:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331584 00000100:00100000:3.0:1788540999.808230:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:3.0:1788540999.808241:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945331584:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:2.0:1788540999.809881:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788540999.809889:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788540999.809910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331712 00000100:00100000:2.0:1788540999.809919:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331712 00000100:00100000:2.0:1788540999.809972:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945331840 00000100:00100000:2.0:1788540999.809976:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945331840 00000100:00100000:2.0:1788540999.810003:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:2.0:1788540999.810014:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945331712:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788540999.810257:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+2:2357:x1875420945331968:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 2427us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540999.810268:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1788540999.810294:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1788540999.810302:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+5:2357:x1875420945332096:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:0.0:1788540999.810329:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1ab0c 00000100:00080000:0.0:1788540999.810339:0:6705:0:(import.c:65:import_set_state_nolock()) ffff98d681ffe000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788540999.810383:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788540999.811515:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540999.822627:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945331584:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 14375us (15532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540999.822644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:3.0:1788540999.822810:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:3.0:1788540999.822828:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945331840:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788540999.822900:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945331840:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 80us (15689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540999.822907:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00080000:3.0:1788540999.823829:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540999.828746:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2360:x1875420945331712:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 18709us (21539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540999.828938:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00010000:00010000:0.0:1788540999.837350:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540999.837440:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d9af4bce-162d-4333-8def-621043259a82+2:2357:x1875420945332096:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 27101us (30090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540999.837454:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:1.0:1788541000.281394:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541000.664328:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968435072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541000.664445:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541000.664750:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435072 00000100:00100000:3.0:1788541000.664759:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435072 00000100:00100000:3.0:1788541000.664839:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788541000.664850:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968435072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541000.664898:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788541000.664988:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541000.682308:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968435072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17449us (17852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541000.682326:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788541000.686541:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9e680 x1875420968435072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541000.686572:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968435072:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788541000.707296:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d9af4bce-162d-4333-8def-621043259a82 00000020:00000080:3.0:1788541000.707306:0:6732:0:(genops.c:885:class_export_put()) final put ffff98d7b5263800/d9af4bce-162d-4333-8def-621043259a82 00000020:00000080:0.0:1788541000.707400:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7b5263800/d9af4bce-162d-4333-8def-621043259a82 for lustre-OST0000 00000020:00000080:0.0:1788541000.707486:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7b5264000 for lustre-OST0000 00010000:00010000:0.0:1788541001.304014:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541001.687616:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968435328:0@lo:400:kworker.0 00000100:00100000:0.0:1788541001.687632:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968435456:0@lo:400:kworker.0 00000100:00100000:1.0:1788541001.687685:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968435200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541001.690307:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541001.690373:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435456 00000100:00100000:3.0:1788541001.690383:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435456 00000100:00100000:0.0:1788541001.690432:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541001.690444:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788541001.690453:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788541001.690462:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968435456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541001.690481:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541001.690514:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968435456:12345-0@lo:400:kworker.0 Request processed in 53us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541001.690521:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541001.690542:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968435456:0@lo:400:kworker.0 00000100:00100000:1.0:1788541001.690612:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541001.690643:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968435712:0@lo:400:kworker.0 00000100:00100000:1.0:1788541001.690666:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541001.690723:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541001.690729:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968435840:0@lo:400:kworker.0 00000100:00100000:3.0:1788541001.690829:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435200 00000100:00100000:3.0:1788541001.690834:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435200 00000100:00100000:3.0:1788541001.690858:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788541001.690865:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541001.691184:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968435200:12345-0@lo:400:kworker.0 Request processed in 318us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541001.691191:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1788541001.691524:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541001.691590:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541001.691621:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968435200:0@lo:400:kworker.0 00000100:00100000:1.0:1788541001.691653:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435584 00000100:00100000:1.0:1788541001.691657:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435584 00000100:00100000:1.0:1788541001.691686:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435840 00000100:00100000:1.0:1788541001.691690:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435840 00000100:00100000:1.0:1788541001.691715:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788541001.691722:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541001.691825:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541001.691833:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968435840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541001.691871:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968435840:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541001.692304:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788541001.692507:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541001.692872:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541001.692873:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968435584:12345-0@lo:400:kworker.0 Request processed in 1151us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541001.692891:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541001.692914:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435712 00000100:00100000:2.0:1788541001.692919:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435712 00000100:00100000:2.0:1788541001.692953:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435328 00000100:00100000:2.0:1788541001.692956:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435328 00000100:00100000:2.0:1788541001.692977:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788541001.692983:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541001.693022:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968435712:12345-0@lo:400:kworker.0 Request processed in 39us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541001.693028:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788541001.693040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788541001.693046:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968435328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541001.693078:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968435328:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541001.693083:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788541001.693099:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541001.693127:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968435328:0@lo:400:kworker.0 00010000:00080000:1.0:1788541001.693150:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9ce00 x1875420968435840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541001.693162:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968435840:0@lo:400:kworker.0 00000100:00100000:1.0:1788541001.693173:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968435712:0@lo:400:kworker.0 00010000:00080000:0.0:1788541001.693189:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9f480 x1875420968435584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541001.693200:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968435584:0@lo:400:kworker.0 00000100:00100000:1.0:1788541002.200391:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541002.200439:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968435968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541002.200528:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541002.200898:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968435968 00000100:00100000:3.0:1788541002.200908:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968435968 00000100:00100000:3.0:1788541002.200959:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788541002.200969:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968435968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541002.201007:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541002.201076:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968435968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541002.201083:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788541002.201390:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9f480 x1875420968435968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541002.201430:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968435968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788541002.327666:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541003.353885:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788541003.423214:0:11035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788541004.337583:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d9af4bce-162d-4333-8def-621043259a82 00000020:00000080:2.0:1788541004.337593:0:7660:0:(genops.c:885:class_export_put()) final put ffff98d681ffc000/d9af4bce-162d-4333-8def-621043259a82 00000020:00000080:0.0:1788541004.337808:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d681ffc000/d9af4bce-162d-4333-8def-621043259a82 for lustre-OST0001 00000020:00000080:0.0:1788541004.337860:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d681ffe000 for lustre-OST0001 00010000:00010000:1.0:1788541004.375606:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541004.923378:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541004.923440:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541004.923464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541004.923488:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332480 00000100:00100000:2.0:1788541004.923497:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332480 00000100:00100000:2.0:1788541004.923555:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332352 00000100:00100000:2.0:1788541004.923558:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332352 00000100:00100000:2.0:1788541004.923596:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:2.0:1788541004.923605:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945332480:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541004.923681:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945332480:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541004.923688:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:2.0:1788541004.923705:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:2.0:1788541004.923710:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945332352:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541004.923731:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945332352:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 21us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541004.923736:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00080000:2.0:1788541004.923753:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541004.924006:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332224 00000100:00100000:3.0:1788541004.924011:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332224 00000100:00100000:3.0:1788541004.924044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:3.0:1788541004.924051:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945332224:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541004.924082:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945332224:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541004.924088:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 229 00010000:00010000:0.0:1788541005.399511:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541005.783653:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968436096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541005.783726:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541005.783792:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436096 00000100:00100000:1.0:1788541005.783799:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436096 00000100:00100000:1.0:1788541005.783852:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541005.783861:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968436096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541005.783892:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541005.783952:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968436096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541005.783959:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788541005.784044:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682927b80 x1875420968436096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541005.784064:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541005.784073:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968436096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788541006.425059:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541006.809668:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968436224:0@lo:400:kworker.0 00000100:00100000:1.0:1788541006.809781:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541006.811029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436224 00000100:00100000:0.0:1788541006.811042:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436224 00000100:00100000:0.0:1788541006.811099:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788541006.811109:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968436224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.811917:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968436352:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.811980:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.812018:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968436864:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812043:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.812063:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541006.812068:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968436736:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812087:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.812110:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968436608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812132:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.812148:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541006.812153:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968436480:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812187:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.812217:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436352 00000100:00100000:2.0:1788541006.812227:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436352 00000100:00100000:2.0:1788541006.812261:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436736 00000100:00100000:2.0:1788541006.812265:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436736 00000100:00100000:2.0:1788541006.812282:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436480 00000100:00100000:2.0:1788541006.812285:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436480 00000100:00100000:2.0:1788541006.812300:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788541006.812307:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968436352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812350:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968436352:12345-0@lo:400:kworker.0 Request processed in 43us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541006.812358:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788541006.812375:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541006.812381:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968436736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812432:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968436736:12345-0@lo:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541006.812439:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541006.812452:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541006.812458:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968436480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812488:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968436480:12345-0@lo:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541006.812495:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541006.812513:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436864 00000100:00100000:2.0:1788541006.812517:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436864 00000100:00100000:2.0:1788541006.812556:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968436608 00000100:00100000:2.0:1788541006.812560:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968436608 00000100:00100000:2.0:1788541006.812577:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788541006.812583:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968436864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812613:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968436864:12345-0@lo:400:kworker.0 Request processed in 30us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541006.812629:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788541006.812641:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788541006.812648:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968436608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812677:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968436608:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541006.812682:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788541006.812706:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541006.812710:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541006.812737:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968436736:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812748:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968436352:0@lo:400:kworker.0 00010000:00080000:2.0:1788541006.812759:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d784c1ea00 x1875420968436864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541006.812768:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968436864:0@lo:400:kworker.0 00000100:00100000:2.0:1788541006.812797:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968436480:0@lo:400:kworker.0 00010000:00080000:2.0:1788541006.812806:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d784c1f100 x1875420968436608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541006.812814:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968436608:0@lo:400:kworker.0 00000100:00100000:0.0:1788541006.812967:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968436224:12345-0@lo:400:kworker.0 Request processed in 1858us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541006.812975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788541006.813096:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968436224:0@lo:400:kworker.0 00000020:00000080:2.0:1788541006.912717:0:11183:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfc9e3f30 20000000:00000080:2.0:1788541006.912741:0:11183:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d790c02800 uarg=0000000000000000 20000000:01000000:2.0:1788541006.912840:0:11183:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788541006.912847:0:11183:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788541006.912852:0:11183:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788541006.914127:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788541006.918188:0:11183:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788541006.937662:0:11183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788541006.937785:0:11183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937816:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937825:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937831:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937840:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937846:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937854:0:11183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937899:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.937914:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 12 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541006.937928:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968436992:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541006.938036:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.938045:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541006.938061:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437120:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541006.938098:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.938106:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 18 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541006.938114:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437248:0@lo:104: 00000100:00100000:0.0:1788541006.938153:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541006.938198:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.938207:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 18 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541006.938227:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437376:0@lo:104: 00000100:00100000:0.0:1788541006.938249:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541006.938281:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.938289:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 18 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541006.938296:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437504:0@lo:104: 00000100:00100000:0.0:1788541006.938315:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541006.938324:0:11183:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7888ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541006.938387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968437248 00000100:00100000:3.0:1788541006.938394:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968437248 00000100:00100000:1.0:1788541006.938668:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968437376 00000100:00100000:1.0:1788541006.938674:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968437376 00000100:00100000:1.0:1788541006.938693:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968437504 00000100:00100000:1.0:1788541006.938695:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968437504 00000100:00100000:1.0:1788541006.938708:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788541006.938718:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:11183:x1875420968437248:12345-0@lo:104: 00010000:00010000:1.0:1788541006.938731:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.938797:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541006.938804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+5:11183:x1875420968437248:12345-0@lo:104: Request processed in 87us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.938811:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788541006.938828:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788541006.938834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:11183:x1875420968437376:12345-0@lo:104: 00010000:00010000:1.0:1788541006.938841:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.938871:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788541006.938876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:11183:x1875420968437376:12345-0@lo:104: Request processed in 44us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.938882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788541006.938895:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788541006.938901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:11183:x1875420968437504:12345-0@lo:104: 00010000:00010000:1.0:1788541006.938908:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.938932:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788541006.938936:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:11183:x1875420968437504:12345-0@lo:104: Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.938941:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788541006.938955:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788541006.938959:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.938965:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788541006.938975:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.938984:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541006.938991:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541006.938997:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788541006.939027:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939034:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541006.939053:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939060:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bc200/0xc9a6a13d3cd1aad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aadb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939073:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541006.939076:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939081:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788541006.939083:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939089:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541006.939104:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541006.939109:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788541006.939123:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939129:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541006.939135:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939141:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1aac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aacd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939151:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541006.939154:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939160:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fc800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788541006.939162:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939167:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541006.939173:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541006.939177:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788541006.939196:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939201:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541006.939229:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939237:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1aab8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1aabf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.939249:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541006.939251:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541006.939253:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541006.939265:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968437888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541006.939299:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541006.939640:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437248:0@lo:104: 00000100:00100000:0.0:1788541006.939650:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437376:0@lo:104: 00000100:00100000:0.0:1788541006.939668:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437504:0@lo:104: 00000100:00100000:2.0:1788541006.944023:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968437760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541006.944088:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.944147:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541006.944153:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968437632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541006.944173:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541006.944231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968437888 00000100:00100000:2.0:1788541006.944240:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968437888 00000100:00100000:1.0:1788541006.944260:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968437760 00000100:00100000:1.0:1788541006.944264:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968437760 00010000:00010000:2.0:1788541006.944278:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 20 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.944279:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 20 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541006.944303:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968437632 00000100:00100000:2.0:1788541006.944307:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968437632 00010000:00010000:2.0:1788541006.944318:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 21 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.948772:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541006.949807:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788541006.949826:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78316c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+21:3316:x1875420968437888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541006.949847:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541006.949858:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 21 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.949873:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 21 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.949891:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1aabf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aab8 expref: 21 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.949924:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541006.950016:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78316c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+20:3316:x1875420968437888:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (10715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.950024:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788541006.950076:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541006.950084:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968437760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541006.950092:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541006.950097:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 19 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.950106:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 19 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.950117:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1aacd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aac6 expref: 19 pid: 5844 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.950127:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541006.950164:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3315:x1875420968437760:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (6076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.950170:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541006.950185:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788541006.950191:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3315:x1875420968437632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541006.950198:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541006.950203:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 17 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.950210:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 17 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.950240:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bd000/0xc9a6a13d3cd1aadb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1aad4 expref: 17 pid: 5843 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.950249:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541006.950274:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3315:x1875420968437632:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (6100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.950280:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541006.950482:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968437888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541006.953909:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968437632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541006.953923:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968437760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541006.955359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541006.955451:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968436992:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541006.955464:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1875420968437120:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541006.955495:0:11183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541006.955577:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332608 00000100:00100000:1.0:1788541006.955585:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332608 00010000:00010000:1.0:1788541006.955623:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 13 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541006.955655:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:1.0:1788541006.955664:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945332608:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541006.955679:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541006.955685:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 13 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.955697:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 13 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.955716:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bdc00/0xc9a6a13d3cd1aaf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1549 expref: 13 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541006.955743:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541006.955804:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2359:x1875420945332608:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 141us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541006.955812:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:2.0:1788541006.956910:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541006.957558:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332736 00000100:00100000:3.0:1788541006.957568:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332736 00010000:00010000:3.0:1788541006.957599:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541006.957636:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:3.0:1788541006.957645:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2360:x1875420945332736:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541006.957656:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541006.957662:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957689:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957704:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1aae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1511 expref: 12 pid: 5844 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957719:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957728:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957757:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957764:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957771:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957777:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957782:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541006.957787:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957795:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957817:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541006.957828:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541006.957882:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:2360:x1875420945332736:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 238us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541006.957890:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00010000:00010000:0.0:1788541006.958054:0:11183:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.958062:0:11183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541006.958067:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab13 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541007.320664:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541007.320700:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968438016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541007.320776:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541007.321059:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438016 00000100:00100000:3.0:1788541007.321067:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438016 00000100:00100000:3.0:1788541007.321115:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788541007.321124:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968438016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541007.321156:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541007.321308:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968438016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541007.321316:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788541007.321385:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d681308a80 x1875420968438016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541007.321404:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968438016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788541007.447907:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541007.996022:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541007.996187:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332864 00000100:00100000:1.0:1788541007.996198:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332864 00000100:00100000:1.0:1788541007.996262:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:1.0:1788541007.996274:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:5600:x1875420945332864:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541007.996295:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541007.996319:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1573 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541007.996362:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541007.996375:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541007.996386:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781678e00, rc 0) 00000100:00100000:1.0:1788541007.996475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945332864:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 203us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541007.996483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:2.0:1788541008.017080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541008.017348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945332992 00000100:00100000:0.0:1788541008.017359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945332992 00000100:00100000:0.0:1788541008.017498:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 232 00000100:00100000:0.0:1788541008.017510:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945332992:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541008.017851:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945332992:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 342us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.017860:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 232 00000100:00100000:1.0:1788541008.028977:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541008.031465:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333120 00000100:00100000:3.0:1788541008.031481:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333120 00000100:00100000:3.0:1788541008.031778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:3.0:1788541008.031793:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945333120:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.032618:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945333120:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 826us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.032640:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:3.0:1788541008.040278:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541008.040355:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333248 00000100:00100000:0.0:1788541008.040366:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333248 00000100:00100000:0.0:1788541008.040436:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 234 00000100:00100000:0.0:1788541008.040456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945333248:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541008.040473:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541008.040492:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac157a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.040533:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.040545:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.040556:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031e00, rc 0) 00000100:00100000:0.0:1788541008.040635:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945333248:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 174us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.040643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 234 00000100:00100000:2.0:1788541008.049852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541008.049938:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333376 00000100:00100000:0.0:1788541008.049951:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333376 00000100:00100000:0.0:1788541008.050012:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 235 00000100:00100000:0.0:1788541008.050023:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945333376:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541008.050325:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945333376:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 303us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.050333:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 235 00000100:00100000:2.0:1788541008.055189:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541008.055275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333504 00000100:00100000:0.0:1788541008.055285:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333504 00000100:00100000:0.0:1788541008.055339:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 236 00000100:00100000:0.0:1788541008.055348:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945333504:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541008.055622:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945333504:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 273us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.055647:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 236 10000000:01000000:2.0:1788541008.088201:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541008.088207:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7bf6df000 from 7 10000000:01000000:2.0:1788541008.088211:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541008.088259:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.088272:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.088295:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541008.088325:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541008.088405:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541008.088459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438144 00000100:00100000:0.0:1788541008.088467:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438144 00000100:00100000:2.0:1788541008.088471:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541008.088523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788541008.088534:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968438144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541008.088548:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541008.088560:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ab28 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.088598:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.088609:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.088618:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030000, rc 0) 00000100:00100000:0.0:1788541008.088664:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968438144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.088670:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788541008.089392:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541008.089423:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.089434:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541008.089500:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541008.089546:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541008.089583:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541008.089592:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438272 00000100:00100000:3.0:1788541008.089598:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438272 00000100:00100000:3.0:1788541008.089643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788541008.089652:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968438272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.090045:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968438272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.090053:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788541008.090128:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541008.090182:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541008.090225:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541008.090250:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831843c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541008.090293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438400 00000100:00100000:3.0:1788541008.090298:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438400 00000100:00100000:3.0:1788541008.090332:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788541008.090340:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968438400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.090830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968438400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.090839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788541008.090883:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541008.093244:0:11208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788541008.093563:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788541008.093589:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541008.093601:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.093613:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541008.093639:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541008.093642:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7831d9800 from 7 10000000:01000000:2.0:1788541008.093645:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541008.093820:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.093829:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.093840:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541008.093867:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541008.093939:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541008.093981:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788541008.094007:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438528 00000100:00100000:1.0:1788541008.094016:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438528 00000100:00100000:1.0:1788541008.094066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788541008.094075:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968438528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541008.094088:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541008.094100:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ab36 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541008.094123:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541008.094133:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541008.094141:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781678c00, rc 0) 00000100:00100000:1.0:1788541008.094266:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968438528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541008.094273:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788541008.094565:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541008.094580:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.094590:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541008.094806:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541008.094838:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541008.094864:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541008.094900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438656 00000100:00100000:3.0:1788541008.094906:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438656 00000100:00100000:3.0:1788541008.094948:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788541008.094955:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968438656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.095221:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968438656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.095229:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788541008.095329:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541008.095361:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541008.095398:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541008.095451:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541008.095563:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438784 00000100:00100000:3.0:1788541008.095569:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438784 00000100:00100000:3.0:1788541008.095605:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788541008.095612:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968438784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.095880:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968438784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.095894:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788541008.095958:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788541008.096955:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788541008.097394:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788541008.097488:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541008.097500:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541008.097511:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541008.097531:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541008.097534:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d782e54800 from 7 10000000:01000000:3.0:1788541008.097537:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541008.097571:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541008.097885:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541008.097898:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541008.097924:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.098058:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541008.098717:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78315f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541008.101295:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968438912 00000100:00100000:0.0:1788541008.101311:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968438912 00000100:00100000:2.0:1788541008.101676:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788541008.101762:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968438912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541008.101780:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541008.101799:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ab44 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.101828:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.101841:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.101850:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fcc00, rc 0) 00000100:00100000:2.0:1788541008.101933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968438912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541008.101940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788541008.102291:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968438912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541008.102311:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541008.102321:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541008.102438:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.102473:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541008.102525:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78315f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541008.102717:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439040 00000100:00100000:0.0:1788541008.102726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439040 00000100:00100000:0.0:1788541008.102768:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788541008.102777:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968439040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541008.103319:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968439040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 541us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.103338:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788541008.103461:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968439040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.103496:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968439168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541008.103549:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541008.103592:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78315f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541008.103721:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439168 00000100:00100000:0.0:1788541008.103726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439168 00000100:00100000:0.0:1788541008.103755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788541008.103762:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968439168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541008.103899:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968439168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.103907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788541008.104075:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968439168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788541008.117089:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788541008.123234:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788541008.123270:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541008.123283:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541008.123295:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541008.473596:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541009.496630:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541010.043305:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541010.043346:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541010.043372:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541010.043402:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333760 00000100:00100000:0.0:1788541010.043433:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333760 00000100:00100000:0.0:1788541010.043492:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333888 00000100:00100000:0.0:1788541010.043509:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333888 00000100:00100000:0.0:1788541010.043536:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:0.0:1788541010.043546:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945333760:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541010.043621:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945333760:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 77us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541010.043628:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:0.0:1788541010.043643:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:0.0:1788541010.043649:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2359:x1875420945333888:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541010.043685:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2359:x1875420945333888:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541010.043701:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00080000:0.0:1788541010.043718:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541010.043901:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945333632 00000100:00100000:3.0:1788541010.043906:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945333632 00000100:00100000:3.0:1788541010.043942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 246 00000100:00100000:3.0:1788541010.043949:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945333632:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541010.043978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789648c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945333632:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541010.043985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 246 00000001:02000400:3.0:1788541010.149100:0:11380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788541010.519583:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541010.904365:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968439296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541010.904506:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.904734:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439296 00000100:00100000:1.0:1788541010.904743:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439296 00000100:00100000:1.0:1788541010.904803:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541010.904812:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968439296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541010.904845:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541010.904948:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968439296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.904970:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788541010.905153:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788541010.906472:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2f6ea00 x1875420968439296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541010.906511:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968439296:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788541011.548019:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541011.929490:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968439552:0@lo:400:kworker.0 00000100:00100000:1.0:1788541011.929568:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541011.929623:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968440064:0@lo:400:kworker.0 00000100:00100000:1.0:1788541011.929648:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541011.929681:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541011.929688:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968439680:0@lo:400:kworker.0 00000100:00100000:1.0:1788541011.929710:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541011.930594:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968439424:0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.930639:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541011.930667:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968439936:0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.930690:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541011.930711:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541011.930717:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968439808:0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.930756:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541011.930789:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439552 00000100:00100000:3.0:1788541011.930796:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439552 00000100:00100000:3.0:1788541011.930839:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439680 00000100:00100000:3.0:1788541011.930841:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439680 00000100:00100000:3.0:1788541011.930863:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439936 00000100:00100000:3.0:1788541011.930866:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439936 00000100:00100000:3.0:1788541011.930881:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788541011.930889:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968439552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.930946:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968439552:12345-0@lo:400:kworker.0 Request processed in 57us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541011.930953:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788541011.930970:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788541011.930976:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.931003:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968439680:12345-0@lo:400:kworker.0 Request processed in 28us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541011.931008:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788541011.931019:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788541011.931024:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968439936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.931180:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968439936:12345-0@lo:400:kworker.0 Request processed in 155us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541011.931187:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788541011.931204:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541011.931345:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968439680:0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.931361:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968439552:0@lo:400:kworker.0 00000100:00100000:3.0:1788541011.931488:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968439936:0@lo:400:kworker.0 00000100:00100000:2.0:1788541011.931766:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440064 00000100:00100000:2.0:1788541011.931772:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440064 00000100:00100000:2.0:1788541011.931809:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439808 00000100:00100000:2.0:1788541011.931812:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439808 00000100:00100000:2.0:1788541011.931832:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541011.931838:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968440064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541011.931885:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968440064:12345-0@lo:400:kworker.0 Request processed in 47us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541011.931891:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541011.931906:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541011.931913:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968439808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541011.931945:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968439808:12345-0@lo:400:kworker.0 Request processed in 33us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541011.931950:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541011.931968:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968439424 00000100:00100000:2.0:1788541011.931972:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968439424 00000100:00100000:2.0:1788541011.931996:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788541011.932002:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968439424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541011.932033:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968439424:12345-0@lo:400:kworker.0 Request processed in 32us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541011.932039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788541011.932154:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788541011.932175:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9e680 x1875420968440064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541011.932187:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968440064:0@lo:400:kworker.0 00010000:00080000:2.0:1788541011.932213:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9d500 x1875420968439808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541011.932231:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968439808:0@lo:400:kworker.0 00000100:00100000:2.0:1788541011.933179:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968439424:0@lo:400:kworker.0 00000100:00100000:3.0:1788541012.443977:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968440192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541012.444080:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541012.445108:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440192 00000100:00100000:0.0:1788541012.445120:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440192 00000100:00100000:0.0:1788541012.445179:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788541012.445191:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968440192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541012.445230:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541012.445312:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968440192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541012.445321:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788541012.445370:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9d500 x1875420968440192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541012.445400:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968440192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541012.570447:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541013.592345:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541014.160178:0:11480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:56:52 (1788541012) === 00000100:00100000:3.0:1788541014.333288:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541014.333333:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541014.333399:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945334144 00000100:00100000:2.0:1788541014.333438:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945334144 00000100:00100000:2.0:1788541014.333511:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1788541014.333524:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:103c367e-0a85-454e-8289-79a7b521f7f2+6:9675:x1875420945334144:12345-192.168.202.59@tcp:700:mkdir.0 00000100:00100000:2.0:1788541014.333606:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:103c367e-0a85-454e-8289-79a7b521f7f2+6:9675:x1875420945334144:12345-192.168.202.59@tcp:700:mkdir.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541014.333614:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00080000:3.0:1788541014.333754:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541014.333800:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945334016 00000100:00100000:1.0:1788541014.333804:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945334016 00000100:00100000:1.0:1788541014.333838:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1788541014.333844:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945334016:12345-192.168.202.59@tcp:41:mkdir.0 00000004:00000024:1.0:1788541014.333873:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788541014.334239:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945334016:12345-192.168.202.59@tcp:41:mkdir.0 Request processed in 393us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.334246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1788541014.337360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.337635:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945334400 00000100:00100000:0.0:1788541014.337647:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945334400 00000100:00100000:0.0:1788541014.337710:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1788541014.337720:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:9675:x1875420945334400:12345-192.168.202.59@tcp:36:mkdir.0 00010000:00010000:0.0:1788541014.337774:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541014.337829:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1aa33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14fc expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.337850:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22b900) 00010000:00010000:0.0:1788541014.337862:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541014.338607:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.338634:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.338644:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.338676:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.338684:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.338691:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541014.351294:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788541014.351317:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.351329:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.351338:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.351343:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.351348:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.351356:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.351394:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22b300) 00010000:00010000:0.0:1788541014.351398:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541014.351403:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.351426:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab52 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541014.351451:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af0cd662 reply state 0000000058114142 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541014.351471:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541014.351599:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:9675:x1875420945334400:12345-192.168.202.59@tcp:36:mkdir.0 Request processed in 13876us (14243us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788541014.351610:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:1.0:1788541014.357100:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.357119:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.357127:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.357149:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.357154:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.357162:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.357182:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d78b22b500) 00010000:00010000:1.0:1788541014.357185:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.357190:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.357196:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1ab59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541014.364180:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.364328:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945334528 00000100:00100000:0.0:1788541014.364339:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945334528 00000100:00100000:0.0:1788541014.364402:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1788541014.364444:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:9676:x1875420945334528:12345-192.168.202.59@tcp:101:chmod.0 00010000:00010000:0.0:1788541014.364475:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541014.364498:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1581 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.364563:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1ab67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.364577:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.364604:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541014.364648:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788541014.364652:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541014.364691:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1ab67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.364715:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ab60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1581 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.364731:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1ab67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1581 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.364739:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22b300) 00010000:00010000:0.0:1788541014.364742:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541014.364745:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:0.0:1788541014.364797:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:9676:x1875420945334528:12345-192.168.202.59@tcp:101:chmod.0 Request processed in 356us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541014.364804:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1788541014.367130:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541014.367210:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945334784 00000100:00100000:3.0:1788541014.367220:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945334784 00000100:00100000:3.0:1788541014.367273:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1788541014.367283:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:9676:x1875420945334784:12345-192.168.202.59@tcp:36:chmod.0 00010000:00010000:3.0:1788541014.367331:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541014.367355:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1ab67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1581 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.367377:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22b300) 00010000:00010000:3.0:1788541014.367388:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541014.367441:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.367454:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.367488:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541014.367799:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf6b57d4 reply state 000000008e1cc63c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541014.367808:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788541014.367816:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788541014.367894:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:9676:x1875420945334784:12345-192.168.202.59@tcp:36:chmod.0 Request processed in 612us (783us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788541014.367902:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00010000:00010000:3.0:1788541014.370468:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.370485:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.370493:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.370499:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541014.370503:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.370512:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.370530:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d100) 00010000:00010000:3.0:1788541014.370533:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788541014.370539:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.370563:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab6e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541014.415103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541014.415148:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945334912 00000100:00100000:1.0:1788541014.415159:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945334912 00000100:00100000:1.0:1788541014.415388:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1788541014.415401:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:9677:x1875420945334912:12345-192.168.202.59@tcp:101:chown.0 00010000:00010000:1.0:1788541014.415441:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541014.415475:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ab75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1588 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.415544:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679a00/0xc9a6a13d3cd1ab7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.415559:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679a00/0xc9a6a13d3cd1ab7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.415591:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679a00/0xc9a6a13d3cd1ab7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541014.415630:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788541014.415634:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541014.415671:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679a00/0xc9a6a13d3cd1ab7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.415697:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ab75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1588 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.415714:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679a00/0xc9a6a13d3cd1ab7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1588 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.415723:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d785548b00) 00010000:00010000:1.0:1788541014.415726:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541014.415729:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781679a00, rc 0) 00000100:00100000:1.0:1788541014.415783:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+8:9677:x1875420945334912:12345-192.168.202.59@tcp:101:chown.0 Request processed in 385us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.415791:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1788541014.424828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541014.424867:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945335040 00000100:00100000:3.0:1788541014.424878:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945335040 00000100:00100000:3.0:1788541014.425720:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:3.0:1788541014.425736:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:9677:x1875420945335040:12345-192.168.202.59@tcp:101:chown.0 00010000:00010000:3.0:1788541014.425757:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541014.425776:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac158f expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.425839:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.425854:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.425866:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.425881:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.425888:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.425895:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430817:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ab98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430839:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430853:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541014.430893:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541014.430897:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541014.430923:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ab98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430949:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430955:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430962:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430968:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2178c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541014.430973:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430979:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.430991:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d785548b00) 00010000:00010000:3.0:1788541014.431007:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541014.431013:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431020:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ab8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431039:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431045:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431050:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431055:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541014.431058:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431064:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431071:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d78320d100) 00010000:00010000:3.0:1788541014.431073:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541014.431075:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431081:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179000/0xc9a6a13d3cd1ab91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431123:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1ab83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac158f expref: 10 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431151:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ab98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac158f expref: 9 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541014.431157:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d78320db00) 00010000:00010000:3.0:1788541014.431160:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541014.431162:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179a00, rc 0) 00000100:00100000:3.0:1788541014.431243:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:9677:x1875420945335040:12345-192.168.202.59@tcp:101:chown.0 Request processed in 5511us (6425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541014.431252:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1788541014.443048:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541014.443095:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945335296 00000100:00100000:2.0:1788541014.443108:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945335296 00000100:00100000:2.0:1788541014.443166:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1788541014.443178:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:9677:x1875420945335296:12345-192.168.202.59@tcp:36:chown.0 00010000:00010000:2.0:1788541014.443231:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541014.443265:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ab98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac158f expref: 9 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.443288:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d78320db00) 00010000:00010000:2.0:1788541014.443301:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541014.443331:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.443346:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.443364:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541014.491968:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1788541014.491999:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788541014.492583:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f563b33c reply state 00000000fcfcc0ca transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541014.492597:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788541014.495231:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788541014.495427:0:5852:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788541014.495451:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:9677:x1875420945335296:12345-192.168.202.59@tcp:36:chown.0 Request processed in 52270us (52408us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788541014.495476:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00010000:00010000:1.0:1788541014.495848:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.495861:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.495869:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.495892:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.495898:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.495906:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.495922:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d786553800) 00010000:00010000:1.0:1788541014.495925:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788541014.495942:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.495949:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ab9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541014.511365:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.511909:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945335424 00000100:00100000:0.0:1788541014.511929:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945335424 00000100:00100000:0.0:1788541014.511999:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:0.0:1788541014.512010:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:9678:x1875420945335424:12345-192.168.202.59@tcp:101:touch.500 00010000:00010000:0.0:1788541014.512036:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541014.512057:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1aba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1596 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541014.512835:0:9724:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 727us 00010000:00010000:1.0:1788541014.523905:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.524477:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.524490:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.524508:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.524515:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.524522:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.525376:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678800/0xc9a6a13d3cd1abbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.525389:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678800/0xc9a6a13d3cd1abbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.525399:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678800/0xc9a6a13d3cd1abbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541014.527325:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788541014.527334:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541014.527382:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678800/0xc9a6a13d3cd1abbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527398:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527429:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527437:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527442:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.527447:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527465:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527479:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d785548b00) 00010000:00010000:1.0:1788541014.527488:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.527493:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527500:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1abad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527511:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527517:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527523:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527527:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.527530:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527535:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527542:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d785548600) 00010000:00010000:1.0:1788541014.527545:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.527547:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527552:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1abb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527592:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1aba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1596 expref: 8 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527617:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678800/0xc9a6a13d3cd1abbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1596 expref: 7 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.527634:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:1.0:1788541014.527636:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788541014.527639:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781678800, rc 0) 00000100:00100000:1.0:1788541014.527707:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:9678:x1875420945335424:12345-192.168.202.59@tcp:101:touch.500 Request processed in 15698us (16351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.527716:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:3.0:1788541014.529871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541014.529980:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945335680 00000100:00100000:2.0:1788541014.529990:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945335680 00000100:00100000:2.0:1788541014.530050:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541014.530061:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:9678:x1875420945335680:12345-192.168.202.59@tcp:101:touch.500 00010000:00010000:2.0:1788541014.530079:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541014.530098:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1abc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac159d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.530352:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.530368:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.530379:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.530467:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.530477:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.530496:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541014.531231:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788541014.531543:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1abd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531555:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1abd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531564:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1abd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531601:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531608:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531615:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531621:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541014.531626:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531634:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531646:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:2.0:1788541014.531649:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541014.531661:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531668:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1abc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541014.531682:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dfb12db reply state 000000003b9e849a transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541014.531691:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788541014.531724:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1abc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac159d expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531739:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1abd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac159d expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.531746:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541014.531749:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541014.531751:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541014.531822:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:9678:x1875420945335680:12345-192.168.202.59@tcp:101:touch.500 Request processed in 1764us (1958us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788541014.531830:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00010000:00010000:1.0:1788541014.533040:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.533053:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.533060:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.533066:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.533070:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.533077:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.533090:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff98d786553e00) 00010000:00010000:1.0:1788541014.533092:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.533096:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.533112:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602a00/0xc9a6a13d3cd1abd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541014.534963:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.535180:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945335936 00000100:00100000:0.0:1788541014.535192:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945335936 00000100:00100000:0.0:1788541014.535245:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:0.0:1788541014.535255:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+9:9678:x1875420945335936:12345-192.168.202.59@tcp:36:touch.500 00010000:00010000:0.0:1788541014.535309:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541014.535331:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1abd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac159d expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.535348:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d786553700) 00010000:00010000:0.0:1788541014.535358:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541014.535398:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.536543:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.536561:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541014.536834:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d13e31b4 reply state 00000000a4ab3073 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541014.536864:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541014.537084:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+10:9678:x1875420945335936:12345-192.168.202.59@tcp:36:touch.500 Request processed in 1828us (2126us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788541014.537092:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1788541014.539835:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:1.0:1788541014.539986:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.539997:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.540003:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.540007:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.540010:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.540015:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.540028:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d78b22b300) 00010000:00010000:1.0:1788541014.540030:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.540033:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.540037:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1abe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541014.540185:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945336064 00000100:00100000:0.0:1788541014.540198:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945336064 00000100:00100000:0.0:1788541014.540298:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:0.0:1788541014.540310:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:9678:x1875420945336064:12345-192.168.202.59@tcp:101:touch.500 00010000:00010000:0.0:1788541014.540333:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541014.540352:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1abec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15a4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.540443:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1abec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15a4 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.540468:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1abec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15a4 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.540486:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d78b22b900) 00010000:00010000:0.0:1788541014.540489:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541014.540491:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6400, rc 0) 00000100:00100000:0.0:1788541014.540545:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:9678:x1875420945336064:12345-192.168.202.59@tcp:101:touch.500 Request processed in 237us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541014.540552:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1788541014.544258:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.544379:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945336192 00000100:00100000:0.0:1788541014.544388:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945336192 00000100:00100000:0.0:1788541014.544477:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1788541014.544486:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875420945336192:12345-192.168.202.59@tcp:8:touch.500 00010000:00080000:0.0:1788541014.544524:0:9248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:0.0:1788541014.544562:0:9248:0:(genops.c:1385:class_connect()) connect: client 103c367e-0a85-454e-8289-79a7b521f7f2, cookie 0xc9a6a13d3cd1abf3 00002000:00100000:0.0:1788541014.544574:0:9248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 103c367e-0a85-454e-8289-79a7b521f7f2/ffff98d7899d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788541014.544601:0:9248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788541014.549702:0:9248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788541014.549752:0:9248:0:(import.c:65:import_set_state_nolock()) ffff98d7b5263800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541014.550569:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2357:x1875420945336192:12345-192.168.202.59@tcp:8:touch.500 Request processed in 6077us (6314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.550603:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1788541014.556178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541014.556684:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945336320 00000100:00100000:2.0:1788541014.556694:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945336320 00000100:00100000:2.0:1788541014.556777:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00080000:3.0:1788541014.556781:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541014.556787:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:0:x1875420945336320:12345-192.168.202.59@tcp:2:touch.500 00000001:00100000:1.0:1788541014.590290:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000001:00080000:1.0:1788541014.590405:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788541014.594046:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:0:x1875420945336320:12345-192.168.202.59@tcp:2:touch.500 Request processed in 37248us (37867us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788541014.594080:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541014.596481:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541014.596569:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945336576 00000100:00100000:3.0:1788541014.596579:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945336576 00000100:00100000:3.0:1788541014.596667:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1788541014.596678:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+10:9678:x1875420945336576:12345-192.168.202.59@tcp:35:touch.500 00000100:00100000:3.0:1788541014.597009:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+11:9678:x1875420945336576:12345-192.168.202.59@tcp:35:touch.500 Request processed in 332us (609us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788541014.597016:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1788541014.611771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541014.612525:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945336704 00000100:00100000:1.0:1788541014.612536:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945336704 00000100:00100000:1.0:1788541014.612650:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:1.0:1788541014.612662:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+11:9679:x1875420945336704:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:1.0:1788541014.612686:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541014.612708:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1abfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15ab expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.612776:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678a00/0xc9a6a13d3cd1ac01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.612789:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678a00/0xc9a6a13d3cd1ac01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.612801:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678a00/0xc9a6a13d3cd1ac01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541014.612836:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788541014.612840:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541014.612876:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678a00/0xc9a6a13d3cd1ac01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.612903:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1abfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ab expref: 13 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.612962:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678a00/0xc9a6a13d3cd1ac01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ab expref: 12 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.612974:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:1.0:1788541014.612978:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541014.612982:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d781678a00, rc 0) 00000100:00100000:1.0:1788541014.613048:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+12:9679:x1875420945336704:12345-192.168.202.59@tcp:101:rm.0 Request processed in 388us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.613055:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1788541014.615982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.617249:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945336960 00000100:00100000:0.0:1788541014.617262:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945336960 00000100:00100000:0.0:1788541014.617329:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:0.0:1788541014.617339:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+12:9679:x1875420945336960:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:0.0:1788541014.617361:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541014.617382:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15b2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541014.617499:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788541014.617680:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15b2 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.617695:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d785548b00) 00010000:00010000:0.0:1788541014.617698:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541014.617703:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15b2 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.617716:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7400, rc 0) 00000100:00100000:0.0:1788541014.617773:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:9679:x1875420945336960:12345-192.168.202.59@tcp:101:rm.0 Request processed in 436us (1802us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788541014.617788:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00010000:00010000:3.0:1788541014.618134:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541014.621869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.622007:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945337088 00000100:00100000:0.0:1788541014.622018:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945337088 00000100:00100000:0.0:1788541014.622074:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:0.0:1788541014.622085:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+13:9679:x1875420945337088:12345-192.168.202.59@tcp:37:rm.0 00000100:00100000:1.0:1788541014.635555:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+13:9679:x1875420945337088:12345-192.168.202.59@tcp:37:rm.0 Request processed in 13457us (13681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.635578:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1788541014.644049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541014.644252:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945337344 00000100:00100000:2.0:1788541014.644263:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945337344 00000100:00100000:2.0:1788541014.644322:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1788541014.644332:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:9679:x1875420945337344:12345-192.168.202.59@tcp:35:rm.0 00000100:00100000:2.0:1788541014.644638:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:9679:x1875420945337344:12345-192.168.202.59@tcp:35:rm.0 Request processed in 306us (601us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788541014.644645:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:3.0:1788541014.647841:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.647950:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945337600 00000100:00100000:0.0:1788541014.647959:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945337600 00000100:00100000:0.0:1788541014.648020:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:0.0:1788541014.648031:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:9679:x1875420945337600:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:0.0:1788541014.648053:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541014.648074:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15b9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.648181:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ac1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.648195:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ac1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.648208:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ac1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541014.648219:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788541014.648342:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15b9 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.648361:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ac1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15b9 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.648389:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:0.0:1788541014.648393:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541014.648396:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7200, rc 0) 00000100:00100000:0.0:1788541014.648514:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+16:9679:x1875420945337600:12345-192.168.202.59@tcp:101:rm.0 Request processed in 485us (681us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788541014.648521:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:3.0:1788541014.651870:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541014.652035:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945337728 00000100:00100000:1.0:1788541014.652046:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945337728 00000100:00100000:1.0:1788541014.652117:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:1.0:1788541014.652129:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+16:9679:x1875420945337728:12345-192.168.202.59@tcp:41:rm.0 00000004:00000024:1.0:1788541014.652187:0:9724:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788541014.652263:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+16:9679:x1875420945337728:12345-192.168.202.59@tcp:41:rm.0 Request processed in 136us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541014.652270:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:1.0:1788541014.655126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.655226:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945337856 00000100:00100000:0.0:1788541014.655246:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945337856 00000100:00100000:0.0:1788541014.655306:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:0.0:1788541014.655317:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+16:9679:x1875420945337856:12345-192.168.202.59@tcp:101:rm.0 00010000:00010000:0.0:1788541014.655335:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541014.655355:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15c0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655616:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655640:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655651:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655666:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655673:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655698:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655801:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655809:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655816:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541014.655844:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788541014.655848:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541014.655867:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655878:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655887:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655894:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.655901:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656144:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.656150:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656168:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656181:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:0.0:1788541014.656184:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541014.656189:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656195:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656209:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656214:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656220:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656224:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.656227:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656243:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656251:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff98d78b22bf00) 00010000:00010000:0.0:1788541014.656254:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541014.656257:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656272:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656309:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15c0 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656322:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15c0 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.656328:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d78b22b900) 00010000:00010000:0.0:1788541014.656330:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541014.656333:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6e00, rc 0) 00000100:00100000:0.0:1788541014.656550:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+17:9679:x1875420945337856:12345-192.168.202.59@tcp:101:rm.0 Request processed in 1234us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541014.656559:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:2.0:1788541014.661024:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541014.661178:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945338112 00000100:00100000:1.0:1788541014.661187:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945338112 00000100:00100000:1.0:1788541014.661318:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:1.0:1788541014.661329:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+17:9679:x1875420945338112:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:1.0:1788541014.661390:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788541014.661524:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ac40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15c0 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661545:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1abec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15a4 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661556:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d78b22b900) 00010000:00010000:1.0:1788541014.661570:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678a00/0xc9a6a13d3cd1ac01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ab expref: 15 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661578:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:1.0:1788541014.661581:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541014.661601:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661614:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661721:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661736:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661744:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661750:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661852:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661860:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.661866:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541014.663079:0:9724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788541014.663092:0:9724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 299662682583ns, next at 300662680555ns, rc = 0 00010000:00010000:1.0:1788541014.663231:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.663319:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.663328:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.663336:0:9724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.663342:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.663347:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.663564:0:9724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541014.663709:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541014.663716:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.663722:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541014.663725:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.663734:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.663745:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d785548e00) 00010000:00010000:2.0:1788541014.663747:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788541014.663751:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.663756:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678600/0xc9a6a13d3cd1ac5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541014.663782:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541014.663784:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541014.663786:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541014.663818:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663825:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663830:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663835:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.663838:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663844:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663859:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98d785548e00) 00010000:00010000:0.0:1788541014.663861:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788541014.663865:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663870:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678400/0xc9a6a13d3cd1ac55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663892:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663898:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663904:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663976:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781679c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.663980:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663986:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.663994:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:0.0:1788541014.663996:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541014.663999:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.664004:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679c00/0xc9a6a13d3cd1ac47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541014.664024:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023249da1 reply state 000000000b5909ec transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541014.664032:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541014.664224:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+16:9679:x1875420945338112:12345-192.168.202.59@tcp:36:rm.0 Request processed in 2893us (3207us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788541014.664247:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:0.0:1788541014.668859:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541014.669480:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945338368 00000100:00100000:2.0:1788541014.669492:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945338368 00000100:00100000:2.0:1788541014.669555:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1788541014.669566:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+16:9679:x1875420945338368:12345-192.168.202.59@tcp:35:rm.0 00000100:00100000:2.0:1788541014.669807:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+17:9679:x1875420945338368:12345-192.168.202.59@tcp:35:rm.0 Request processed in 242us (958us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788541014.669815:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1788541014.673166:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541014.673329:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945338624 00000100:00100000:0.0:1788541014.673338:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945338624 00000100:00100000:0.0:1788541014.673394:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:0.0:1788541014.673404:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+17:9679:x1875420945338624:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:0.0:1788541014.673663:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788541014.673688:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ac1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15b9 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673705:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781678800/0xc9a6a13d3cd1abbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1596 expref: 16 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673714:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d785548d00) 00010000:00010000:0.0:1788541014.673729:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679a00/0xc9a6a13d3cd1ab7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1588 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673736:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d785548b00) 00010000:00010000:0.0:1788541014.673741:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541014.673762:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673789:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673799:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673812:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673820:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.673827:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.674335:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.674346:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.674354:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541014.675307:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788541014.675324:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675332:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675338:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675352:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.675357:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675365:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675376:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98d78b22bd00) 00010000:00010000:0.0:1788541014.675378:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788541014.675382:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675388:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ac71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675577:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675585:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675590:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675595:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541014.675598:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675605:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675715:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22bf00) 00010000:00010000:0.0:1788541014.675718:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541014.675722:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541014.675727:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ac63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541014.675742:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd0f4e0c reply state 00000000b56feae9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541014.675750:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788541014.675946:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.675960:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.675967:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.675972:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781679e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.675975:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.675981:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.675990:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff98d785548a00) 00010000:00010000:1.0:1788541014.675993:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.675995:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.676000:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d781679e00/0xc9a6a13d3cd1ac4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541014.676062:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+15:9679:x1875420945338624:12345-192.168.202.59@tcp:36:rm.0 Request processed in 2656us (2901us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788541014.676072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00010000:00010000:1.0:1788541014.685435:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.685463:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.685472:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.685478:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541014.685498:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.685507:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.685524:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98d78b22b000) 00010000:00010000:1.0:1788541014.685527:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541014.685532:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541014.685539:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ac6a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541015.163495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541015.163597:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945338752 00000100:00100000:0.0:1788541015.163608:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945338752 00000100:00100000:0.0:1788541015.163668:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 248 00000100:00100000:0.0:1788541015.163678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945338752:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541015.163748:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945338752:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.163755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 248 00000100:00100000:0.0:1788541015.167513:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541015.171552:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945338880 00000100:00100000:2.0:1788541015.171567:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945338880 00000100:00100000:2.0:1788541015.171668:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:2.0:1788541015.171679:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945338880:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541015.171771:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945338880:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (4267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541015.171779:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00080000:3.0:1788541015.172901:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788541015.639720:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541016.024542:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541016.024566:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541016.024640:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541016.025323:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440320 00000100:00100000:3.0:1788541016.025332:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440320 00000100:00100000:3.0:1788541016.025389:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788541016.025398:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968440320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541016.025454:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541016.025512:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968440320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541016.025519:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788541016.025542:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541016.025570:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd2300 x1875420968440320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541016.025590:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968440320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788541016.663586:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541017.059566:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968440576:0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.059669:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541017.059722:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968441088:0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.059748:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541017.059781:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541017.059787:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968440704:0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.059809:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541017.059846:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440576 00000100:00100000:3.0:1788541017.059859:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440576 00000100:00100000:3.0:1788541017.059908:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440704 00000100:00100000:3.0:1788541017.059910:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440704 00000100:00100000:1.0:1788541017.060128:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968440832:0@lo:400:kworker.0 00000100:00100000:1.0:1788541017.060157:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541017.060179:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788541017.060183:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968440448:0@lo:400:kworker.0 00000100:00100000:1.0:1788541017.060204:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541017.060220:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968440960:0@lo:400:kworker.0 00000100:00100000:1.0:1788541017.060235:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541017.060285:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440448 00000100:00100000:2.0:1788541017.060289:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440448 00000100:00100000:2.0:1788541017.060316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788541017.060324:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541017.060373:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968440448:12345-0@lo:400:kworker.0 Request processed in 50us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541017.060380:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788541017.061834:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968440448:0@lo:400:kworker.0 00000100:00100000:1.0:1788541017.061869:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441088 00000100:00100000:1.0:1788541017.061873:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441088 00000100:00100000:1.0:1788541017.061911:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440832 00000100:00100000:1.0:1788541017.061913:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440832 00000100:00100000:1.0:1788541017.062889:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788541017.062900:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968441088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541017.063098:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968441088:12345-0@lo:400:kworker.0 Request processed in 191us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541017.063106:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788541017.063122:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788541017.063128:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968440832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541017.063157:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968440832:12345-0@lo:400:kworker.0 Request processed in 30us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541017.063163:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788541017.063193:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78386d880 x1875420968440832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541017.063205:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968440832:0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.063525:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968440960 00000100:00100000:3.0:1788541017.063531:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968440960 00000100:00100000:3.0:1788541017.063565:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788541017.063571:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968440576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.063605:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968440576:12345-0@lo:400:kworker.0 Request processed in 35us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541017.063611:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788541017.063621:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788541017.063626:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968440704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.063647:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968440704:12345-0@lo:400:kworker.0 Request processed in 21us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541017.063652:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788541017.063660:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788541017.063665:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968440960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541017.063692:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968440960:12345-0@lo:400:kworker.0 Request processed in 28us (3456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541017.063697:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788541017.063714:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541017.063718:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541017.063901:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968440960:0@lo:400:kworker.0 00010000:00080000:0.0:1788541017.064202:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d78386ea00 x1875420968441088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541017.064213:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968441088:0@lo:400:kworker.0 00000100:00100000:0.0:1788541017.064228:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968440704:0@lo:400:kworker.0 00000100:00100000:0.0:1788541017.064245:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968440576:0@lo:400:kworker.0 00000004:00080000:0.0:1788541017.560111:0:7937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 302559699664ns, next at 303559697469ns, rc = 0 00000100:00100000:3.0:1788541017.560288:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968441216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541017.560356:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541017.560766:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441216 00000100:00100000:2.0:1788541017.560774:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441216 00000100:00100000:2.0:1788541017.560826:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788541017.560835:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968441216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541017.560876:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541017.560935:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968441216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541017.560942:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788541017.561162:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7adf9c700 x1875420968441216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541017.561181:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968441216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788541017.687681:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541018.714557:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541019.738023:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788541019.750047:0:11631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:0.0:1788541019.793014:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788541019.793049:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788541019.793069:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788541019.795169:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968441344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788541019.795248:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541019.796042:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441344 00000100:00100000:1.0:1788541019.796052:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441344 00000100:00100000:1.0:1788541019.796137:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541019.796147:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968441344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788541019.796175:0:9248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788541019.796211:0:9248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9af856, atime: 0x6a9af856, ctime: 0x6a9af856, blocks: 0x1 00010000:00010000:1.0:1788541019.796219:0:9248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541019.796233:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1788541019.796238:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541019.796255:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541019.796283:0:9248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541019.796294:0:9248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541019.796302:0:9248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541019.796322:0:9248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788541019.796675:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541019.798333:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968441344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2180us (3077us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788541019.798346:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788541019.798933:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541019.798942:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541019.798953:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541019.798958:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541019.798968:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541019.798991:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541019.798999:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1ac78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541019.799032:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541019.799035:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541019.799036:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788541019.804981:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d78386ed80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788541019.804998:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968441344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788541020.288971:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541020.289017:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541020.289047:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541020.289142:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541020.289171:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339136 00000100:00100000:0.0:1788541020.289182:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339136 00000100:00100000:0.0:1788541020.289240:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339392 00000100:00100000:0.0:1788541020.289244:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339392 00000100:00100000:0.0:1788541020.289268:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:0.0:1788541020.289278:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945339136:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541020.289543:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339008 00000100:00100000:2.0:1788541020.289549:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339008 00000100:00100000:2.0:1788541020.289577:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 250 00000100:00100000:2.0:1788541020.289585:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945339008:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541020.289615:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945339008:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541020.289622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 250 00000100:00100000:0.0:1788541020.289860:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945339136:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 582us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.289868:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:0.0:1788541020.289894:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:0.0:1788541020.289902:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945339392:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541020.289930:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945339392:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 30us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.289936:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00080000:0.0:1788541020.289954:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541020.290230:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339264 00000100:00100000:3.0:1788541020.290236:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339264 00000100:00100000:3.0:1788541020.290287:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:3.0:1788541020.290295:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945339264:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541020.290332:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945339264:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 40us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541020.290338:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00080000:0.0:1788541020.290960:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788541020.761579:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541021.150552:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968441472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541021.150624:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541021.150698:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441472 00000100:00100000:2.0:1788541021.150705:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441472 00000100:00100000:2.0:1788541021.150760:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788541021.150769:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968441472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541021.150817:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788541021.152498:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541021.153008:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968441472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541021.153028:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788541021.153711:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd2680 x1875420968441472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541021.153737:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968441472:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788541021.206008:0:11680:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec50b5110 20000000:00000080:2.0:1788541021.206033:0:11680:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d7899fb400 uarg=0000000000000000 20000000:01000000:2.0:1788541021.206069:0:11680:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788541021.206075:0:11680:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788541021.206080:0:11680:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788541021.208736:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788541021.208922:0:11680:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788541021.218576:0:11680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788541021.218640:0:11680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788541021.218699:0:11680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788541021.218718:0:11680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788541021.218738:0:11680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218759:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218768:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218786:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218792:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218799:0:11680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218806:0:11680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218859:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.218875:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 18 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.218888:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441600:0@lo:104: 00000100:00100000:1.0:1788541021.218953:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541021.219117:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.219126:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 18 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.219135:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441728:0@lo:104: 00000100:00100000:1.0:1788541021.219158:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541021.220224:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.220245:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 18 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.220266:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441856:0@lo:104: 00000100:00100000:1.0:1788541021.220309:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541021.220623:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441600 00000100:00100000:0.0:1788541021.220632:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441600 00000100:00100000:0.0:1788541021.220675:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441728 00000100:00100000:0.0:1788541021.220678:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441728 00000100:00100000:0.0:1788541021.220692:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541021.220702:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:11680:x1875420968441600:12345-0@lo:104: 00010000:00010000:0.0:1788541021.220715:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541021.220812:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788541021.220819:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:11680:x1875420968441600:12345-0@lo:104: Request processed in 119us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541021.220826:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788541021.220843:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788541021.220850:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:11680:x1875420968441728:12345-0@lo:104: 00010000:00010000:0.0:1788541021.220858:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.220949:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.220959:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 12 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.220970:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441984:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541021.221027:0:11680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.221035:0:11680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.221044:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc719880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968442112:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541021.221066:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788541021.221086:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441600:0@lo:104: 00000100:00100000:1.0:1788541021.221094:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441728:0@lo:104: 00000100:00100000:2.0:1788541021.221155:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968441856 00000100:00100000:2.0:1788541021.221160:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968441856 00010000:00010000:3.0:1788541021.221198:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541021.221206:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221213:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179e00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541021.221218:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221227:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541021.221234:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541021.221240:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541021.221369:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221376:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541021.221435:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221444:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7c2179e00/0xc9a6a13d3cd1ab44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab4b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221459:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541021.221463:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221468:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fc800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541021.221471:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.221478:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541021.221485:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541021.221490:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788541021.221864:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968442240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541021.221900:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541021.222026:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788541021.222033:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+4:11680:x1875420968441728:12345-0@lo:104: Request processed in 1183us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541021.222041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788541021.223087:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788541021.223110:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541021.223118:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:11680:x1875420968441856:12345-0@lo:104: 00010000:00010000:0.0:1788541021.223134:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223376:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223383:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541021.223425:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223443:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7813fc800/0xc9a6a13d3cd1ab36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab3d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223456:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541021.223460:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223465:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fd000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541021.223469:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223476:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541021.223481:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541021.223486:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541021.223500:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223505:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541021.223514:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223520:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7813fd000/0xc9a6a13d3cd1ab28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1ab2f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.223532:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541021.223539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541021.223582:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541021.223618:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441856:0@lo:104: 00000100:00100000:2.0:1788541021.223703:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968442496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541021.223740:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541021.223839:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968442240 00000100:00100000:1.0:1788541021.223845:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968442240 00010000:00010000:1.0:1788541021.223868:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 19 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.223898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968442496 00000100:00100000:1.0:1788541021.223902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968442496 00010000:00010000:1.0:1788541021.223914:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 20 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.223931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541021.223936:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+20:3316:x1875420968442240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541021.223949:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541021.223954:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 20 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.223964:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 20 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.223977:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fcc00/0xc9a6a13d3cd1ab4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab44 expref: 20 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.223991:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541021.224018:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968442240:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541021.224024:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541021.224037:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788541021.224043:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3314:x1875420968442496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541021.224050:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541021.224060:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 18 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.224068:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 18 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.224078:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1ab2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab28 expref: 18 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.224088:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541021.224112:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968442496:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541021.224118:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788541021.224181:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968442496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541021.224781:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968442368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541021.224830:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541021.225429:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788541021.225440:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6c6c881b-c5d1-4767-bf18-6c64f558276e+3:11680:x1875420968441856:12345-0@lo:104: Request processed in 2321us (5129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541021.225449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788541021.225540:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541021.225584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968442368 00000100:00100000:2.0:1788541021.225590:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968442368 00010000:00010000:2.0:1788541021.225617:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 17 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541021.225677:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788541021.225685:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78316cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3317:x1875420968442368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541021.225696:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541021.225700:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 17 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.225710:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 17 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.225725:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781678c00/0xc9a6a13d3cd1ab3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1ab36 expref: 17 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.225738:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541021.225788:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78316cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3317:x1875420968442368:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541021.225814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541021.225889:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968442368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541021.226878:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541021.226911:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968442240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541021.227225:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541021.227283:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7aeca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968441984:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541021.227292:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc719880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11680:1875420968442112:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541021.227321:0:11680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541021.227704:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541021.227750:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339520 00000100:00100000:1.0:1788541021.227757:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339520 00010000:00010000:1.0:1788541021.227792:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 13 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541021.227904:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:1.0:1788541021.227914:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945339520:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541021.227926:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541021.227931:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 13 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.227942:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 13 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.227973:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031e00/0xc9a6a13d3cd1ab21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac157a expref: 13 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.227989:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541021.228037:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2358:x1875420945339520:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 125us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541021.228043:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:2.0:1788541021.228539:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339648 00000100:00100000:2.0:1788541021.228545:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339648 00010000:00010000:2.0:1788541021.228577:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541021.228597:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:2.0:1788541021.228604:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2359:x1875420945339648:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541021.228614:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541021.228618:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228627:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228638:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781678e00/0xc9a6a13d3cd1ab1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1573 expref: 12 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228650:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228658:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228672:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228678:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228696:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228703:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228709:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541021.228713:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228722:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228736:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541021.228746:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541021.228776:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:2359:x1875420945339648:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 173us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541021.228783:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00010000:00010000:3.0:1788541021.229207:0:11680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.229217:0:11680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541021.229222:0:11680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1ac7f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541021.784285:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541022.168364:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968443008:0@lo:400:kworker.0 00000100:00100000:3.0:1788541022.168485:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541022.168571:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788541022.168577:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968442624:0@lo:400:kworker.0 00000100:00100000:3.0:1788541022.168614:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541022.168640:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968443136:0@lo:400:kworker.0 00000100:00100000:3.0:1788541022.168663:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541022.168692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968442624 00000100:00100000:3.0:1788541022.168700:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968442624 00000100:00100000:3.0:1788541022.168742:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788541022.168750:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3314:x1875420968442624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541022.168830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3314:x1875420968442624:12345-0@lo:400:kworker.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.168838:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788541022.168895:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968442624:0@lo:400:kworker.0 00000100:00100000:0.0:1788541022.170113:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968442880:0@lo:400:kworker.0 00000100:00100000:0.0:1788541022.170162:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.170212:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788541022.170220:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968442752:0@lo:400:kworker.0 00000100:00100000:0.0:1788541022.170242:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.170261:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968443264:0@lo:400:kworker.0 00000100:00100000:0.0:1788541022.170284:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.170313:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443136 00000100:00100000:0.0:1788541022.170320:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443136 00000100:00100000:0.0:1788541022.170364:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968442880 00000100:00100000:0.0:1788541022.170367:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968442880 00000100:00100000:0.0:1788541022.170382:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968442752 00000100:00100000:0.0:1788541022.170395:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968442752 00000100:00100000:0.0:1788541022.170453:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788541022.170461:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968443136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541022.170504:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968443136:12345-0@lo:400:kworker.0 Request processed in 45us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.170510:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788541022.170535:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788541022.170541:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968442880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541022.170892:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443008 00000100:00100000:1.0:1788541022.170897:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443008 00000100:00100000:1.0:1788541022.170928:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443264 00000100:00100000:1.0:1788541022.170931:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443264 00000100:00100000:1.0:1788541022.170953:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788541022.170960:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968443008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541022.171038:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541022.171048:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968443264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541022.171133:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788541022.171142:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968442752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541022.180010:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968443008:12345-0@lo:400:kworker.0 Request processed in 9039us (11514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541022.180027:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788541022.180123:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541022.180129:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541022.180178:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968442880:0@lo:400:kworker.0 00000100:00100000:2.0:1788541022.180840:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968443264:12345-0@lo:400:kworker.0 Request processed in 9793us (10553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541022.180851:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541022.180915:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968443136:0@lo:400:kworker.0 00010000:00080000:2.0:1788541022.180931:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd3b80 x1875420968443008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541022.180970:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968443008:0@lo:400:kworker.0 00000100:00100000:3.0:1788541022.181528:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968442752:12345-0@lo:400:kworker.0 Request processed in 10384us (11281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.181539:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788541022.184678:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968442752:0@lo:400:kworker.0 00000100:00100000:1.0:1788541022.184698:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968443264:0@lo:400:kworker.0 00000100:00100000:0.0:1788541022.202273:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968442880:12345-0@lo:400:kworker.0 Request processed in 31721us (32099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.202288:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 10000000:01000000:2.0:1788541022.424294:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541022.424303:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7bf6df000 from 7 10000000:01000000:2.0:1788541022.424309:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541022.424370:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541022.424392:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541022.424404:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541022.424462:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968443392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541022.424534:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541022.424607:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541022.428838:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443392 00000100:00100000:0.0:1788541022.428857:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443392 00000100:00100000:0.0:1788541022.428936:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788541022.428949:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:5848:x1875420968443392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541022.428966:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541022.428992:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f7a00/0xc9a6a13d3cd1ac8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ac86 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.429033:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f7a00/0xc9a6a13d3cd1ac8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ac86 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.429044:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f7a00/0xc9a6a13d3cd1ac8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ac86 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.429054:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7a00, rc 0) 00000100:00100000:0.0:1788541022.429152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968443392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.429159:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788541022.429642:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968443392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541022.429662:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541022.429672:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541022.429753:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968443520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541022.429793:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541022.429838:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541022.429905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443520 00000100:00100000:1.0:1788541022.429912:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443520 00000100:00100000:1.0:1788541022.429949:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788541022.429958:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968443520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541022.430296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968443520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541022.430303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788541022.430440:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968443520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541022.430478:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968443648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541022.430520:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541022.430554:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7888eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541022.430934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443648 00000100:00100000:1.0:1788541022.430940:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443648 00000100:00100000:1.0:1788541022.430978:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788541022.430985:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968443648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541022.431167:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d789649050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968443648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541022.431174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788541022.431456:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968443648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541022.432525:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11693:1875420968443776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541022.432612:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541022.432639:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541022.433445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443776 00000100:00100000:1.0:1788541022.433456:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443776 00000100:00100000:1.0:1788541022.433518:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788541022.433529:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:11693:x1875420968443776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541022.434713:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78964bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:11693:x1875420968443776:12345-0@lo:502:llog_process_th.0 Request processed in 1178us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541022.434725:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788541022.434861:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11693:1875420968443776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541022.434900:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541022.434911:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541022.434914:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541022.434920:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d7bf6df000 00000020:00000080:2.0:1788541022.434922:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788541022.435014:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11693:1875420968443904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541022.435682:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541022.435715:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78325f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541022.436496:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968443904 00000100:00100000:0.0:1788541022.436506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968443904 00000100:00100000:0.0:1788541022.440505:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788541022.440529:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:11693:x1875420968443904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.440808:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798056c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:11693:x1875420968443904:12345-0@lo:502:llog_process_th.0 Request processed in 289us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.440823:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788541022.442364:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11693:1875420968443904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541022.442453:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541022.442462:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541022.442465:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788541022.442470:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788541022.442631:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788541022.442653:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541022.442663:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541022.442675:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541022.442686:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541022.442689:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7831d9800 from 7 10000000:01000000:2.0:1788541022.442691:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541022.442728:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541022.442744:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541022.442755:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541022.442777:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541022.442828:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541022.457929:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78325f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541022.461822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444032 00000100:00100000:3.0:1788541022.461837:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444032 00000100:00100000:3.0:1788541022.461902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788541022.461912:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:5848:x1875420968444032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541022.461929:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541022.461949:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7c2179e00/0xc9a6a13d3cd1ac9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ac94 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.461979:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7c2179e00/0xc9a6a13d3cd1ac9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ac94 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.462009:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7c2179e00/0xc9a6a13d3cd1ac9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ac94 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.462020:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179e00, rc 0) 00000100:00100000:3.0:1788541022.462341:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798055450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968444032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 430us (19512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.462349:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788541022.462461:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541022.462478:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.462487:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541022.463928:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541022.463992:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541022.464159:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7888ee180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541022.464185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444160 00000100:00100000:3.0:1788541022.464952:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444160 00000100:00100000:3.0:1788541022.465001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788541022.465009:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968444160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541022.467972:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798057450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968444160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2954us (3969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.467986:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788541022.468120:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.468176:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.468235:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.468273:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541022.469113:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444288 00000100:00100000:3.0:1788541022.469122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444288 00000100:00100000:3.0:1788541022.469173:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788541022.469181:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968444288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541022.471391:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968444288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2193us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.471405:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788541022.471514:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.473272:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11696:1875420968444416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.473360:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.473403:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541022.473812:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444416 00000100:00100000:3.0:1788541022.473818:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444416 00000100:00100000:3.0:1788541022.473855:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788541022.473863:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:11696:x1875420968444416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541022.474049:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:11696:x1875420968444416:12345-0@lo:502:llog_process_th.0 Request processed in 186us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.474056:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788541022.476225:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11696:1875420968444416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541022.476275:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541022.476288:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541022.476290:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541022.476303:0:11696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d7831d9800 00000020:00000080:0.0:1788541022.476306:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788541022.476431:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11696:1875420968444544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.476499:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.476530:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541022.480000:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444544 00000100:00100000:3.0:1788541022.480016:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444544 00000100:00100000:3.0:1788541022.480086:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788541022.480097:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:11696:x1875420968444544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541022.480753:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:11696:x1875420968444544:12345-0@lo:502:llog_process_th.0 Request processed in 655us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.480762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788541022.480916:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11696:1875420968444544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541022.480951:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541022.480959:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541022.480962:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788541022.480971:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788541022.481044:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788541022.481074:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541022.481084:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.481095:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541022.481106:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541022.481108:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d782e54800 from 7 10000000:01000000:0.0:1788541022.481111:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541022.481141:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.481150:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.481159:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541022.481178:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.481468:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.481496:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541022.481652:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444672 00000100:00100000:3.0:1788541022.481658:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444672 00000100:00100000:3.0:1788541022.481691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788541022.481698:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:5848:x1875420968444672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541022.481709:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541022.481721:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1aca9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1aca2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.481755:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1aca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aca2 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.481766:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1aca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aca2 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541022.481775:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179c00, rc 0) 00000100:00100000:3.0:1788541022.483959:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968444672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2250us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541022.483971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788541022.484275:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541022.484301:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541022.484313:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541022.484396:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.484471:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.501674:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541022.501838:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444800 00000100:00100000:2.0:1788541022.501848:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444800 00000100:00100000:2.0:1788541022.501913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788541022.501924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968444800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541022.502229:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968444800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (17756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541022.502237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788541022.502590:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.502643:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.502691:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.502709:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616180 going to sleep for 11 seconds 00000100:00100000:0.0:1788541022.502724:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968444928 00000100:00100000:0.0:1788541022.502727:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968444928 00000100:00100000:0.0:1788541022.502748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788541022.502754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968444928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.502911:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:5848:x1875420968444928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.502917:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788541022.502949:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6c6c881b-c5d1-4767-bf18-6c64f558276e:5848:1875420968444928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541022.503146:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11698:1875420968445056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.503178:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.503214:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445056 00000100:00100000:0.0:1788541022.503218:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445056 00000100:00100000:0.0:1788541022.503236:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788541022.503242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:11698:x1875420968445056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.503360:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:11698:x1875420968445056:12345-0@lo:502:llog_process_th.0 Request processed in 117us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.503366:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788541022.503426:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541022.503442:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11698:1875420968445056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541022.503469:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541022.503477:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541022.503480:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541022.503490:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d782e54800 00000020:00000080:0.0:1788541022.503492:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788541022.503874:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11698:1875420968445184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.503909:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.503929:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445184 00000100:00100000:0.0:1788541022.503934:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445184 00000100:00100000:0.0:1788541022.503956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788541022.503963:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:11698:x1875420968445184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541022.504083:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:11698:x1875420968445184:12345-0@lo:502:llog_process_th.0 Request processed in 120us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.504090:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788541022.504116:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541022.504128:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6c6c881b-c5d1-4767-bf18-6c64f558276e:11698:1875420968445184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541022.504147:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541022.504151:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541022.504153:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788541022.504159:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788541022.507558:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788541022.507601:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788541022.507612:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541022.507623:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541022.508779:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788541022.679913:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541022.679939:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541022.680012:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541022.681269:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445312 00000100:00100000:0.0:1788541022.681281:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445312 00000100:00100000:0.0:1788541022.681349:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788541022.681359:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875420968445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541022.681434:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541022.681509:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875420968445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541022.681530:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541022.681757:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968445312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541022.807710:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541023.037598:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541023.038313:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339776 00000100:00100000:0.0:1788541023.038325:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339776 00000100:00100000:0.0:1788541023.038392:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 267 00000100:00100000:0.0:1788541023.038402:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:5600:x1875420945339776:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541023.038449:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541023.038468:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f7000/0xc9a6a13d3cd1acb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541023.038498:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f7000/0xc9a6a13d3cd1acb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15c7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541023.038510:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f7000/0xc9a6a13d3cd1acb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15c7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541023.038520:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7000, rc 0) 00000100:00100000:0.0:1788541023.038894:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945339776:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 492us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.038902:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 267 00000100:00100000:0.0:1788541023.057702:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541023.057818:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945339904 00000100:00100000:3.0:1788541023.057829:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945339904 00000100:00100000:3.0:1788541023.057888:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 268 00000100:00100000:3.0:1788541023.057898:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945339904:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541023.058755:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945339904:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 854us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541023.058765:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 268 00000100:00100000:1.0:1788541023.069516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541023.069618:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340032 00000100:00100000:0.0:1788541023.069630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340032 00000100:00100000:0.0:1788541023.069691:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 269 00000100:00100000:0.0:1788541023.069702:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945340032:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541023.069963:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945340032:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 251us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.069983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 269 00000100:00100000:2.0:1788541023.075176:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541023.075597:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340160 00000100:00100000:3.0:1788541023.075611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340160 00000100:00100000:3.0:1788541023.075670:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 270 00000100:00100000:3.0:1788541023.075682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:9950:x1875420945340160:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541023.076036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:9950:x1875420945340160:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 354us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541023.076055:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 270 00000100:00100000:1.0:1788541023.088073:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541023.088504:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340288 00000100:00100000:2.0:1788541023.088516:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340288 00000100:00100000:2.0:1788541023.088648:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 271 00000100:00100000:2.0:1788541023.088660:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:9950:x1875420945340288:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541023.088921:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79804a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:9950:x1875420945340288:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 262us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541023.088930:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 271 00000100:00100000:1.0:1788541023.109806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541023.110122:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340416 00000100:00100000:3.0:1788541023.110133:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340416 00000100:00100000:3.0:1788541023.110191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 272 00000100:00100000:3.0:1788541023.110212:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:5600:x1875420945340416:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541023.110230:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541023.110261:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1acb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15ce expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541023.110291:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1acb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ce expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541023.110303:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1acb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ce expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541023.110311:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179000, rc 0) 00000100:00100000:3.0:1788541023.110370:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945340416:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 171us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541023.110385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 272 00000100:00100000:2.0:1788541023.121994:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541023.122092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340544 00000100:00100000:0.0:1788541023.122103:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340544 00000100:00100000:0.0:1788541023.122160:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 273 00000100:00100000:0.0:1788541023.122170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945340544:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541023.122550:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945340544:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 372us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.122559:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 273 00000100:00100000:1.0:1788541023.126703:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541023.126963:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340672 00000100:00100000:2.0:1788541023.126974:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340672 00000100:00100000:2.0:1788541023.127041:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 274 00000100:00100000:2.0:1788541023.127051:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945340672:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541023.127308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798048c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:5600:x1875420945340672:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 258us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541023.127317:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 274 00000100:00100000:1.0:1788541023.131480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541023.131891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340800 00000100:00100000:3.0:1788541023.131901:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340800 00000100:00100000:3.0:1788541023.131959:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 275 00000100:00100000:3.0:1788541023.131969:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:9953:x1875420945340800:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541023.132229:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:9953:x1875420945340800:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 260us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541023.132253:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 275 00000100:00100000:3.0:1788541023.134896:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541023.140856:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945340928 00000100:00100000:0.0:1788541023.140875:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945340928 00000100:00100000:0.0:1788541023.140950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 276 00000100:00100000:0.0:1788541023.140961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:9953:x1875420945340928:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541023.141733:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:9953:x1875420945340928:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 770us (6842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.141743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 276 00000040:00080000:2.0:1788541023.512776:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788541023.831627:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541024.855735:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541024.857280:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1788541025.402697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541025.403149:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541025.403270:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541025.403320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541025.403351:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341312 00000100:00100000:1.0:1788541025.403370:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341312 00000100:00100000:1.0:1788541025.403470:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:1.0:1788541025.403480:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945341312:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541025.403564:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945341312:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541025.403571:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00080000:1.0:1788541025.403594:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541025.403926:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341056 00000100:00100000:2.0:1788541025.403931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341056 00000100:00100000:2.0:1788541025.403968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 277 00000100:00100000:2.0:1788541025.403976:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945341056:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541025.404020:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945341056:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 44us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541025.404027:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 277 00000100:00100000:3.0:1788541025.404261:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341184 00000100:00100000:3.0:1788541025.404267:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341184 00000100:00100000:3.0:1788541025.404313:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341440 00000100:00100000:3.0:1788541025.404317:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341440 00000100:00100000:3.0:1788541025.404339:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 105 00000100:00100000:3.0:1788541025.404345:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945341184:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541025.404387:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945341184:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 42us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541025.404393:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 105 00000100:00100000:3.0:1788541025.404423:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00100000:3.0:1788541025.404431:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945341440:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541025.404457:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945341440:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 27us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541025.404463:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00080000:2.0:1788541025.404533:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788541025.880131:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541026.264546:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541026.264573:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541026.264650:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541026.264727:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445440 00000100:00100000:0.0:1788541026.264736:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445440 00000100:00100000:0.0:1788541026.264795:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788541026.264817:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968445440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541026.264854:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541026.264898:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968445440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541026.264923:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788541026.264948:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541026.264976:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd1f80 x1875420968445440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541026.264994:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968445440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788541026.906908:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541027.288402:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968445824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541027.288498:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541027.288691:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968445952:0@lo:400:kworker.0 00000100:00100000:2.0:1788541027.288729:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541027.288815:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788541027.288821:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968445568:0@lo:400:kworker.0 00000100:00100000:2.0:1788541027.288850:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541027.288870:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968446080:0@lo:400:kworker.0 00000100:00100000:2.0:1788541027.288897:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445952 00000100:00100000:2.0:1788541027.288904:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445952 00000100:00100000:2.0:1788541027.289296:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788541027.289306:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968445952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541027.289373:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968445952:12345-0@lo:400:kworker.0 Request processed in 68us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541027.289381:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788541027.289728:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968445696:0@lo:400:kworker.0 00000100:00100000:1.0:1788541027.289778:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541027.289798:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968446208:0@lo:400:kworker.0 00000100:00100000:1.0:1788541027.289826:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541027.289854:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445824 00000100:00100000:1.0:1788541027.289858:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445824 00000100:00100000:1.0:1788541027.289888:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445696 00000100:00100000:1.0:1788541027.289890:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445696 00000100:00100000:1.0:1788541027.289905:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788541027.289911:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541027.290177:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968445824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541027.290215:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446208 00000100:00100000:3.0:1788541027.290219:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446208 00000100:00100000:3.0:1788541027.290246:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788541027.290253:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541027.290295:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968446208:12345-0@lo:400:kworker.0 Request processed in 43us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541027.290302:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788541027.290330:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788541027.290335:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d78386ed80, transno 4294967300 00000100:00100000:3.0:1788541027.290357:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968446208:0@lo:400:kworker.0 00000100:00100000:3.0:1788541027.290384:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788541027.290392:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968445696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541027.290448:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968445696:12345-0@lo:400:kworker.0 Request processed in 57us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541027.290455:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788541027.290480:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968445696:0@lo:400:kworker.0 00000100:00100000:1.0:1788541027.290660:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968445824:12345-0@lo:400:kworker.0 Request processed in 747us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541027.290667:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541027.291114:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788541027.291155:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7ad2b1880 x1875420968445952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541027.291167:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968445952:0@lo:400:kworker.0 00000100:00100000:2.0:1788541027.291186:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446080 00000100:00100000:2.0:1788541027.291190:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446080 00000100:00100000:2.0:1788541027.291213:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541027.291219:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541027.291255:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968446080:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541027.291261:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541027.291285:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968446080:0@lo:400:kworker.0 00000100:00100000:0.0:1788541027.291523:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968445568 00000100:00100000:0.0:1788541027.291529:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968445568 00000100:00100000:0.0:1788541027.291576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788541027.291583:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968445568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541027.291620:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968445568:12345-0@lo:400:kworker.0 Request processed in 38us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541027.291626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:0.0:1788541027.291653:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541027.291657:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541027.292315:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968445568:0@lo:400:kworker.0 00000100:00100000:1.0:1788541027.800112:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541027.800192:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541027.801088:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446336 00000100:00100000:2.0:1788541027.801098:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446336 00000100:00100000:2.0:1788541027.801156:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788541027.801166:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968446336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541027.801202:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541027.801318:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968446336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541027.801367:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541027.808672:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968446336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788541027.929906:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541028.951636:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541029.976533:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541030.530976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541030.531502:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341568 00000100:00100000:3.0:1788541030.531517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341568 00000100:00100000:3.0:1788541030.531598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 279 00000100:00100000:3.0:1788541030.531611:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945341568:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541030.531897:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945341568:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 288us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.531906:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 279 00000100:00100000:0.0:1788541030.563768:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541030.563819:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541030.563916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541030.563925:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341696 00000100:00100000:1.0:1788541030.563944:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341696 00000100:00100000:0.0:1788541030.564059:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341952 00000100:00100000:0.0:1788541030.564067:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341952 00000100:00100000:0.0:1788541030.564092:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:0.0:1788541030.564106:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2359:x1875420945341696:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:1.0:1788541030.564114:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541030.564142:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:1.0:1788541030.564164:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945341952:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541030.564179:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2359:x1875420945341696:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 75us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541030.564188:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:1.0:1788541030.564235:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945341952:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 80us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541030.564246:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:0.0:1788541030.564946:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945341824 00000100:00100000:0.0:1788541030.564964:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945341824 00000100:00100000:0.0:1788541030.565040:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:0.0:1788541030.565048:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945341824:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541030.565084:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945341824:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 37us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541030.565091:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00080000:1.0:1788541030.565207:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788541031.001891:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541031.385763:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968446464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541031.385837:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541031.386358:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446464 00000100:00100000:1.0:1788541031.386367:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446464 00000100:00100000:1.0:1788541031.386445:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788541031.386455:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968446464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541031.386498:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541031.386544:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968446464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541031.386561:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788541031.386897:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd1180 x1875420968446464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541031.386918:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968446464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788541031.387170:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788541032.030677:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541032.408077:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968446976:0@lo:400:kworker.0 00000100:00100000:1.0:1788541032.408108:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968446720:0@lo:400:kworker.0 00000100:00100000:3.0:1788541032.408171:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968446592:0@lo:400:kworker.0 00000100:00100000:1.0:1788541032.410165:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541032.410238:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968447232:0@lo:400:kworker.0 00000100:00100000:1.0:1788541032.410279:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541032.416285:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446720 00000100:00100000:2.0:1788541032.416310:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446720 00000100:00100000:2.0:1788541032.416426:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788541032.416437:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968446720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541032.416523:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968446720:12345-0@lo:400:kworker.0 Request processed in 89us (6365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541032.416531:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788541032.416585:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447232 00000100:00100000:2.0:1788541032.416590:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447232 00000100:00100000:2.0:1788541032.416632:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788541032.416639:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968447232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541032.416673:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968447232:12345-0@lo:400:kworker.0 Request processed in 34us (6394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541032.416679:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788541032.416704:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968446848:0@lo:400:kworker.0 00000100:00100000:2.0:1788541032.416754:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541032.416871:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541032.416881:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968447232:0@lo:400:kworker.0 00000100:00100000:0.0:1788541032.416899:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446848 00000100:00100000:0.0:1788541032.416903:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446848 00000100:00100000:1.0:1788541032.416909:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968446720:0@lo:400:kworker.0 00000100:00100000:0.0:1788541032.416928:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541032.416935:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968446848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541032.416957:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446976 00000100:00100000:1.0:1788541032.416960:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446976 00000100:00100000:0.0:1788541032.416966:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968446848:12345-0@lo:400:kworker.0 Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541032.416972:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788541032.417058:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788541032.417070:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968446976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541032.417108:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968446976:12345-0@lo:400:kworker.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541032.417144:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968446848:0@lo:400:kworker.0 00000100:00080000:2.0:1788541032.417163:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541032.417168:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788541032.419187:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd3100 x1875420968446976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541032.419204:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968446976:0@lo:400:kworker.0 00000100:00100000:3.0:1788541032.422056:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541032.422125:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968447104:0@lo:400:kworker.0 00000100:00100000:3.0:1788541032.422187:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541032.422324:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447104 00000100:00100000:0.0:1788541032.422338:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447104 00000100:00100000:0.0:1788541032.422426:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788541032.422435:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968447104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541032.422485:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968447104:12345-0@lo:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541032.422492:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788541032.422580:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541032.422625:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968447104:0@lo:400:kworker.0 00000100:00100000:2.0:1788541032.423909:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968446592 00000100:00100000:2.0:1788541032.423918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968446592 00000100:00100000:2.0:1788541032.423968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788541032.423977:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968446592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541032.424051:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968446592:12345-0@lo:400:kworker.0 Request processed in 75us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541032.424065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788541032.424786:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788541032.424824:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968446592:0@lo:400:kworker.0 00000100:00100000:1.0:1788541032.919665:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541032.919692:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968447360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541032.919761:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541032.919801:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447360 00000100:00100000:1.0:1788541032.919808:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447360 00000100:00100000:1.0:1788541032.919858:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788541032.919866:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968447360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541032.919903:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541032.919949:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968447360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541032.919955:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788541032.920049:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968447360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541033.052208:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541033.752514:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541034.072398:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541035.095803:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541035.651959:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541035.652001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541035.652065:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342208 00000100:00100000:0.0:1788541035.652075:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342208 00000100:00100000:0.0:1788541035.652154:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:0.0:1788541035.652165:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2361:x1875420945342208:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541035.652242:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2361:x1875420945342208:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.652250:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00080000:2.0:1788541035.652750:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541035.653274:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342080 00000100:00100000:3.0:1788541035.653281:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342080 00000100:00100000:3.0:1788541035.653324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 281 00000100:00100000:3.0:1788541035.653334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945342080:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541035.653550:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945342080:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 217us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541035.653557:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 281 00000100:00100000:1.0:1788541035.675034:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541035.675089:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541035.675188:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342336 00000100:00100000:2.0:1788541035.675198:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342336 00000100:00100000:2.0:1788541035.675298:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1788541035.675309:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2357:x1875420945342336:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:2.0:1788541035.675341:0:9248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1abf3 00000100:00080000:2.0:1788541035.675351:0:9248:0:(import.c:65:import_set_state_nolock()) ffff98d7b5263800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541035.675389:0:9248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788541035.675728:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+2:2357:x1875420945342336:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 420us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541035.675738:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1788541035.676153:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342464 00000100:00100000:0.0:1788541035.676159:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342464 00000100:00100000:0.0:1788541035.676207:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:0.0:1788541035.676216:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945342464:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541035.676252:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945342464:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 39us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.676259:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00010000:00010000:0.0:1788541035.676291:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788541035.676714:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541035.676720:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788541036.126048:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541036.503869:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968447488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541036.503950:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541036.504095:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447488 00000100:00100000:1.0:1788541036.504105:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447488 00000100:00100000:1.0:1788541036.504183:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788541036.504192:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968447488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541036.504228:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541036.504291:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968447488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541036.504298:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788541036.504337:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7b2fd2300 x1875420968447488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541036.504355:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968447488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788541036.504437:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788541037.144735:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541037.528456:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968447872:0@lo:400:kworker.0 00000100:00100000:1.0:1788541037.528567:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541037.528650:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788541037.528656:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968447744:0@lo:400:kworker.0 00000100:00100000:1.0:1788541037.528677:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541037.528693:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968448256:0@lo:400:kworker.0 00000100:00100000:1.0:1788541037.528717:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541037.528756:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448256 00000100:00100000:1.0:1788541037.528767:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448256 00000100:00100000:0.0:1788541037.528800:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788541037.528843:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541037.528846:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788541037.528857:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968448256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541037.528883:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788541037.528888:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968447616:0@lo:400:kworker.0 00000100:00100000:0.0:1788541037.528920:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541037.528929:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968448256:12345-0@lo:400:kworker.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541037.528937:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541037.528939:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968448128:0@lo:400:kworker.0 00000100:00100000:1.0:1788541037.528955:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448000 00000100:00100000:1.0:1788541037.528959:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448000 00000100:00100000:0.0:1788541037.528974:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541037.529003:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447616 00000100:00100000:0.0:1788541037.529007:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447616 00000100:00100000:0.0:1788541037.529038:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788541037.529045:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968447616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541037.529080:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968447616:12345-0@lo:400:kworker.0 Request processed in 36us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.529086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:2.0:1788541037.529186:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541037.529240:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447872 00000100:00100000:2.0:1788541037.529254:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447872 00000100:00100000:0.0:1788541037.529310:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968447744 00000100:00100000:1.0:1788541037.529311:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788541037.529313:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968447744 00000100:00100000:1.0:1788541037.529318:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968448000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541037.529457:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968448000:12345-0@lo:400:kworker.0 Request processed in 139us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541037.529465:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788541037.529517:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968448256:0@lo:400:kworker.0 00000100:00100000:2.0:1788541037.535454:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448128 00000100:00100000:2.0:1788541037.535476:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448128 00000100:00100000:3.0:1788541037.535822:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788541037.535840:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968447872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541037.535984:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968447872:12345-0@lo:400:kworker.0 Request processed in 149us (7417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.535991:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788541037.541934:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968447616:0@lo:400:kworker.0 00010000:00080000:1.0:1788541037.545623:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7899b2300 x1875420968448000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541037.545654:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968448000:0@lo:400:kworker.0 00000100:00100000:1.0:1788541037.545771:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968447872:0@lo:400:kworker.0 00000100:00100000:0.0:1788541037.547311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788541037.547339:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968447744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541037.547528:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968447744:12345-0@lo:400:kworker.0 Request processed in 203us (18849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.547537:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788541037.548122:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968447744:0@lo:400:kworker.0 00000100:00100000:2.0:1788541037.549212:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788541037.549235:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968448128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541037.549953:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968448128:12345-0@lo:400:kworker.0 Request processed in 727us (20988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.549971:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788541037.550015:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541037.553502:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968448128:0@lo:400:kworker.0 00000100:00100000:3.0:1788541038.042987:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541038.043020:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968448384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541038.043117:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541038.045563:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448384 00000100:00100000:0.0:1788541038.045585:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448384 00000100:00100000:0.0:1788541038.045687:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788541038.045701:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968448384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541038.045767:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541038.045889:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968448384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541038.045915:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788541038.046193:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968448384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541038.170484:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541039.191582:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788541040.182706:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:1.0:1788541040.182715:0:7660:0:(genops.c:885:class_export_put()) final put ffff98d7899d3800/103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:0.0:1788541040.183841:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7899d3800/103c367e-0a85-454e-8289-79a7b521f7f2 for lustre-OST0001 00000020:00000080:0.0:1788541040.188568:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7b5263800 for lustre-OST0001 00010000:00010000:3.0:1788541040.215747:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541040.774950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541040.774992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541040.775027:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541040.775156:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342848 00000100:00100000:0.0:1788541040.775166:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342848 00000100:00100000:0.0:1788541040.775260:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342720 00000100:00100000:0.0:1788541040.775264:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342720 00000100:00100000:0.0:1788541040.775288:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:0.0:1788541040.775297:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945342848:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541040.775394:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945342848:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 87us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541040.775402:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:0.0:1788541040.775474:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:0.0:1788541040.775482:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945342720:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541040.775510:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945342720:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 30us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541040.775516:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00080000:1.0:1788541040.776854:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541040.777098:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342592 00000100:00100000:3.0:1788541040.777200:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342592 00000100:00100000:3.0:1788541040.777266:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 283 00000100:00100000:3.0:1788541040.777276:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945342592:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541040.777344:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945342592:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 70us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541040.777351:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 283 00010000:00010000:0.0:1788541041.239603:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541041.624635:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968448512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541041.624710:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541041.624820:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448512 00000100:00100000:1.0:1788541041.624829:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448512 00000100:00100000:1.0:1788541041.624908:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788541041.624919:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968448512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541041.624957:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541041.625002:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968448512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541041.625010:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788541041.625187:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541041.625228:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7899b0a80 x1875420968448512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541041.625247:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968448512:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788541042.265442:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541042.648658:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968448768:0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.648738:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541042.648801:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968449280:0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.648830:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541042.648889:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541042.648895:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968448896:0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.648941:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541042.648985:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448768 00000100:00100000:3.0:1788541042.648993:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448768 00000100:00100000:3.0:1788541042.649046:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448896 00000100:00100000:3.0:1788541042.649050:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448896 00000100:00100000:3.0:1788541042.649094:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541042.649106:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968448768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649340:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968449024:0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649374:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541042.649403:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788541042.649435:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968448640:0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649466:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541042.649488:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968449152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649512:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541042.649535:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449280 00000100:00100000:1.0:1788541042.649539:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449280 00000100:00100000:1.0:1788541042.649570:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449024 00000100:00100000:1.0:1788541042.649574:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449024 00000100:00100000:1.0:1788541042.649592:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541042.649598:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aeca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968449280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649637:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aeca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968449280:12345-0@lo:400:kworker.0 Request processed in 38us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541042.649644:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541042.649661:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788541042.649675:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968449024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649707:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968449024:12345-0@lo:400:kworker.0 Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541042.649713:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788541042.649732:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968448640 00000100:00100000:1.0:1788541042.649736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968448640 00000100:00100000:1.0:1788541042.649757:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788541042.649763:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968448640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.649788:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968448640:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541042.649794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788541042.649842:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968448640:0@lo:400:kworker.0 00010000:00080000:1.0:1788541042.649871:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7ad2b1880 x1875420968449024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541042.649883:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968449024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.650021:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968448768:12345-0@lo:400:kworker.0 Request processed in 917us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541042.650029:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541042.650042:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449152 00000100:00100000:3.0:1788541042.650052:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449152 00000100:00100000:3.0:1788541042.650075:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788541042.650080:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968448896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.650116:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968448896:12345-0@lo:400:kworker.0 Request processed in 37us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541042.650121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788541042.650130:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788541042.650135:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968449152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.650262:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968449152:12345-0@lo:400:kworker.0 Request processed in 126us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541042.650269:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788541042.650298:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541042.650302:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541042.650324:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968448896:0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.650335:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968448768:0@lo:400:kworker.0 00000100:00100000:3.0:1788541042.650344:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968449280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541042.650563:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968449152:0@lo:400:kworker.0 00000100:00100000:2.0:1788541043.160403:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541043.160448:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968449408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541043.160517:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541043.160604:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449408 00000100:00100000:2.0:1788541043.160611:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449408 00000100:00100000:2.0:1788541043.160672:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788541043.160681:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968449408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541043.160717:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541043.160761:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968449408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541043.160769:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788541043.160819:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968449408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788541043.292189:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541043.996371:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788541044.312606:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541045.335613:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541045.894699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541045.894745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541045.894770:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541045.894797:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945343104 00000100:00100000:1.0:1788541045.894806:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945343104 00000100:00100000:1.0:1788541045.894874:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945343232 00000100:00100000:1.0:1788541045.894877:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945343232 00000100:00100000:1.0:1788541045.894902:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:1.0:1788541045.894911:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945343104:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541045.894997:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945343104:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541045.895005:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:1.0:1788541045.895023:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:1.0:1788541045.895030:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945343232:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541045.895054:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945343232:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541045.895060:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00080000:1.0:1788541045.895076:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541045.895569:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945342976 00000100:00100000:2.0:1788541045.895574:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945342976 00000100:00100000:2.0:1788541045.895606:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 285 00000100:00100000:2.0:1788541045.895613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945342976:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541045.895641:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945342976:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541045.895648:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 285 00000001:02000400:1.0:1788541046.286645:0:11861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:57:24 (1788541044) 00010000:00010000:3.0:1788541046.360612:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541046.746749:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968449536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541046.746833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541046.747040:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449536 00000100:00100000:3.0:1788541046.747049:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449536 00000100:00100000:3.0:1788541046.747121:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788541046.747133:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968449536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541046.747204:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788541046.747461:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541046.752185:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968449536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5043us (5340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541046.752202:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788541046.754288:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7899b1c00 x1875420968449536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541046.754318:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968449536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788541047.384862:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541047.769135:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968449792:0@lo:400:kworker.0 00000100:00100000:2.0:1788541047.769225:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541047.769284:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968450304:0@lo:400:kworker.0 00000100:00100000:2.0:1788541047.769342:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541047.769381:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968449920:0@lo:400:kworker.0 00000100:00100000:3.0:1788541047.769512:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541047.769546:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449792 00000100:00100000:2.0:1788541047.769555:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449792 00000100:00100000:2.0:1788541047.769601:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449920 00000100:00100000:2.0:1788541047.769605:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449920 00000100:00100000:2.0:1788541047.769639:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788541047.769650:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968449792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541047.769661:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788541047.769673:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968449920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541047.769726:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968449920:12345-0@lo:400:kworker.0 Request processed in 57us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541047.770046:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968450304 00000100:00100000:1.0:1788541047.770051:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968450304 00000100:00100000:3.0:1788541047.780093:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788541047.780093:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968449792:12345-0@lo:400:kworker.0 Request processed in 84us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541047.780110:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788541047.782554:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968449792:0@lo:400:kworker.0 00000100:00100000:2.0:1788541047.782641:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968449920:0@lo:400:kworker.0 00000100:00080000:3.0:1788541047.783137:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541047.783142:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541047.783622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968450048:0@lo:400:kworker.0 00000100:00100000:3.0:1788541047.783688:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541047.783972:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968449664:0@lo:400:kworker.0 00000100:00100000:1.0:1788541047.784005:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788541047.784050:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541047.784074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968449664 00000100:00100000:0.0:1788541047.784081:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968449664 00000100:00100000:0.0:1788541047.784126:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788541047.784135:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968449664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541047.784136:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968450048 00000100:00100000:2.0:1788541047.784143:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968450048 00000100:00100000:2.0:1788541047.784186:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788541047.784195:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968450048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541047.784201:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3315:x1875420968449664:12345-0@lo:400:kworker.0 Request processed in 67us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541047.784210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788541047.784244:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968450048:12345-0@lo:400:kworker.0 Request processed in 50us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541047.784253:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788541047.784265:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c6c881b-c5d1-4767-bf18-6c64f558276e:3315:1875420968449664:0@lo:400:kworker.0 00000100:00100000:0.0:1788541047.784275:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968450176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541047.784303:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541047.784327:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968450176 00000100:00100000:0.0:1788541047.784331:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968450176 00000100:00100000:0.0:1788541047.784364:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788541047.784378:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968450304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541047.784378:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968450176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541047.784434:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968450176:12345-0@lo:400:kworker.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541047.784440:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788541047.784454:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541047.784474:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968450176:0@lo:400:kworker.0 00010000:00080000:2.0:1788541047.805487:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7899b1500 x1875420968450048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541047.805506:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968450048:0@lo:400:kworker.0 00000100:00100000:0.0:1788541047.805778:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968450304:12345-0@lo:400:kworker.0 Request processed in 21759us (36432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541047.805804:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788541047.806915:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968450304:0@lo:400:kworker.0 00000100:00100000:1.0:1788541048.163567:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541048.163734:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945343360 00000100:00100000:3.0:1788541048.163744:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945343360 00000100:00100000:3.0:1788541048.163828:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:3.0:1788541048.163840:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:10220:x1875420945343360:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541048.163859:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541048.163883:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1acbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15d5 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.163946:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1acc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.163961:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1acc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.163975:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1acc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541048.164007:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541048.164024:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541048.164064:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1acc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.164087:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1acbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15d5 expref: 7 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.164107:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1acc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15d5 expref: 6 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.164115:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d100) 00010000:00010000:3.0:1788541048.164117:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541048.164121:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2178c00, rc 0) 00000100:00100000:3.0:1788541048.164201:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:10220:x1875420945343360:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 364us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541048.164208:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00080000:0.0:1788541048.164657:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541048.183114:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541048.183234:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945343488 00000100:00100000:0.0:1788541048.183245:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945343488 00000100:00100000:0.0:1788541048.183316:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:0.0:1788541048.183328:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:10221:x1875420945343488:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541048.183349:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541048.183371:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1accc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15dc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183474:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183489:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183501:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183516:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183524:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183545:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183793:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ace1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183815:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ace1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183823:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ace1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541048.183853:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788541048.183857:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541048.183879:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ace1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183889:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183896:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183902:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183906:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541048.183910:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183917:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183929:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d100) 00010000:00010000:0.0:1788541048.183932:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541048.183935:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183950:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1acd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183963:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183969:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183974:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183978:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541048.183981:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183987:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.183994:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98d78b22b500) 00010000:00010000:0.0:1788541048.183996:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541048.183999:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.184004:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1acda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.184034:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1accc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15dc expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.184049:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ace1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15dc expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541048.184063:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d78b22b800) 00010000:00010000:0.0:1788541048.184065:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541048.184068:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6e00, rc 0) 00000100:00100000:0.0:1788541048.184134:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:10221:x1875420945343488:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 808us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541048.184142:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:2.0:1788541048.188583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541048.188645:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945343744 00000100:00100000:3.0:1788541048.188655:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945343744 00000100:00100000:3.0:1788541048.188712:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:3.0:1788541048.188723:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:10221:x1875420945343744:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541048.188742:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541048.188762:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1ace8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15e3 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.188846:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.188860:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.188888:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.188943:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.188951:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.188959:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191577:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fd000/0xc9a6a13d3cd1acfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191599:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fd000/0xc9a6a13d3cd1acfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191610:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fd000/0xc9a6a13d3cd1acfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541048.191622:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788541048.191769:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191778:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191786:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191792:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541048.191803:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191811:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191823:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d78b22b800) 00010000:00010000:3.0:1788541048.191826:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541048.191831:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191837:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1acef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191851:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191857:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191863:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191869:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fcc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541048.191872:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191877:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191884:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98d78320d900) 00010000:00010000:3.0:1788541048.191886:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541048.191895:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.191901:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1acf6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.192361:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1ace8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15e3 expref: 10 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.192380:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fd000/0xc9a6a13d3cd1acfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15e3 expref: 9 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541048.192388:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:3.0:1788541048.192391:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541048.192394:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fd000, rc 0) 00000100:00100000:3.0:1788541048.192496:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:10221:x1875420945343744:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 3774us (3923us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788541048.192506:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:1.0:1788541048.205546:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541048.205716:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945343872 00000100:00100000:0.0:1788541048.205726:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945343872 00000100:00100000:0.0:1788541048.205791:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:0.0:1788541048.205803:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:10221:x1875420945343872:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788541048.205926:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:10221:x1875420945343872:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 125us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541048.205934:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1788541048.280124:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968450432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541048.280217:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541048.281313:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968450432 00000100:00100000:2.0:1788541048.281333:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968450432 00000100:00100000:2.0:1788541048.281391:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541048.281403:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968450432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541048.281459:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541048.281520:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968450432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541048.281525:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788541048.281831:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968450432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541048.417580:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541049.135829:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541049.436057:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541050.222911:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.222961:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945344000 00000100:00100000:3.0:1788541050.222973:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945344000 00000100:00100000:3.0:1788541050.223091:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1788541050.223103:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:10264:x1875420945344000:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541050.223124:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541050.223164:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fc800/0xc9a6a13d3cd1ad0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223252:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223268:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223283:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223299:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223307:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223313:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223546:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223552:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223557:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223560:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fcc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.223563:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223576:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223585:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d100) 00010000:00010000:3.0:1788541050.223587:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.223590:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223594:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223603:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223607:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223611:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223614:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.223615:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223618:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223622:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98d78320db00) 00010000:00010000:3.0:1788541050.223623:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.223625:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223634:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223665:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fc800/0xc9a6a13d3cd1ad0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ea expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223675:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d100) 00010000:00010000:3.0:1788541050.223677:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.223680:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fc800/0xc9a6a13d3cd1ad0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ea expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.223689:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7813fc800, rc 0) 00000100:00100000:3.0:1788541050.223744:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:10264:x1875420945344000:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 644us (843us total) trans 0 rc 301/301 00000100:00100000:3.0:1788541050.223751:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00080000:0.0:1788541050.223949:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541050.228210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541050.228375:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945344256 00000100:00100000:0.0:1788541050.228389:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945344256 00000100:00100000:0.0:1788541050.228590:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:0.0:1788541050.228599:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:10264:x1875420945344256:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:0.0:1788541050.228650:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541050.228675:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1acc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15d5 expref: 9 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.228714:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d100) 00010000:00010000:0.0:1788541050.228726:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541050.228937:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.228947:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.228955:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.228964:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.228968:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.228972:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541050.229850:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788541050.229863:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.229870:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.229877:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.229882:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541050.229895:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.229904:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.229916:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541050.229919:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541050.229923:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.229930:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1ad20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541050.229946:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000805b3411 reply state 00000000050ee9ba transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541050.229956:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541050.230058:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:10264:x1875420945344256:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 1457us (1859us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788541050.230067:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00010000:00010000:3.0:1788541050.232996:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.233012:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.233019:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.233024:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.233030:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.233037:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.233069:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98d78b22bb00) 00010000:00010000:3.0:1788541050.233072:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.233076:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.233082:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1ad27 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541050.278699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.280632:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945344384 00000100:00100000:3.0:1788541050.280647:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945344384 00000100:00100000:2.0:1788541050.281029:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:2.0:1788541050.281043:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:10272:x1875420945344384:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:2.0:1788541050.281070:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541050.281094:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1ad2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15f1 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.281174:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1ad35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.281188:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1ad35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.281211:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1ad35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541050.281247:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788541050.281251:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541050.281291:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1ad35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.281314:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1ad2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15f1 expref: 11 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.281353:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1ad35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15f1 expref: 10 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.281361:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:2.0:1788541050.281364:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541050.281367:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602c00, rc 0) 00000100:00100000:2.0:1788541050.281489:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+10:10272:x1875420945344384:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 448us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541050.281496:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1788541050.350898:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.350941:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945344512 00000100:00100000:3.0:1788541050.350952:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945344512 00000100:00100000:3.0:1788541050.351007:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:3.0:1788541050.351018:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+10:10278:x1875420945344512:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541050.351038:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541050.351059:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fc800/0xc9a6a13d3cd1ad3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351121:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351146:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351158:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351176:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351195:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351203:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351694:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ad51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351705:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ad51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351713:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ad51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541050.351741:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788541050.351745:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541050.351844:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ad51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351857:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351864:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351871:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351878:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.351882:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351897:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351910:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541050.351914:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.351919:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351925:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fdc00/0xc9a6a13d3cd1ad43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351939:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351945:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351951:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351955:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7813fcc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.351958:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351964:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351970:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff98d78320db00) 00010000:00010000:3.0:1788541050.351973:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.351976:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.351993:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fcc00/0xc9a6a13d3cd1ad4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.352028:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fc800/0xc9a6a13d3cd1ad3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15f8 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.352041:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ad51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15f8 expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.352048:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541050.352051:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788541050.352053:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2178c00, rc 0) 00000100:00100000:3.0:1788541050.352118:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+11:10278:x1875420945344512:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1101us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541050.352126:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:3.0:1788541050.356006:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.356043:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945344768 00000100:00100000:3.0:1788541050.356053:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945344768 00000100:00100000:3.0:1788541050.356109:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:3.0:1788541050.356119:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+11:10278:x1875420945344768:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541050.356150:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541050.356170:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1ad58 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac15ff expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.357673:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.357704:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.357715:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.357744:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.357751:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.357759:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541050.358501:0:9724:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788541050.359729:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359748:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359759:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359871:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359879:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359886:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359901:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.359906:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359914:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359927:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541050.359930:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.359935:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.359942:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1ad5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541050.359957:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9c119e4 reply state 00000000b70e4742 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541050.359965:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788541050.360003:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1ad58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 14 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.360021:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 13 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.360030:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:3.0:1788541050.360032:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541050.360034:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cca00, rc 0) 00000100:00100000:3.0:1788541050.360121:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+14:10278:x1875420945344768:12345-192.168.202.59@tcp:101:bash.0 Request processed in 4003us (4124us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788541050.360147:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00010000:00010000:1.0:1788541050.364373:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.364392:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.364521:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.364527:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cce00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541050.364533:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.364542:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.364558:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78320da00) 00010000:00010000:1.0:1788541050.364561:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541050.364566:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.364573:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1ad66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541050.367980:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541050.369514:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945344896 00000100:00100000:1.0:1788541050.369529:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945344896 00000100:00100000:1.0:1788541050.369574:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1788541050.369582:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875420945344896:12345-192.168.202.59@tcp:8:bash.0 00010000:00080000:1.0:1788541050.369612:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:1.0:1788541050.369635:0:6705:0:(genops.c:1385:class_connect()) connect: client 103c367e-0a85-454e-8289-79a7b521f7f2, cookie 0xc9a6a13d3cd1ad7b 00002000:00100000:1.0:1788541050.369644:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 103c367e-0a85-454e-8289-79a7b521f7f2/ffff98d7bf5d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788541050.369662:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788541050.369781:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788541050.369823:0:6705:0:(import.c:65:import_set_state_nolock()) ffff98d7bf5d5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541050.369892:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2357:x1875420945344896:12345-192.168.202.59@tcp:8:bash.0 Request processed in 308us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541050.369900:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:1.0:1788541050.378581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541050.378773:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945345024 00000100:00100000:2.0:1788541050.378784:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945345024 00000100:00100000:2.0:1788541050.378905:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1788541050.378916:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:0:x1875420945345024:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541050.378934:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541050.378959:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1606 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541050.378985:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788541050.379009:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788541050.379632:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541050.379645:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.379673:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.379710:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603e00, rc 0) 00000100:00100000:2.0:1788541050.379779:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:0:x1875420945345024:12345-192.168.202.59@tcp:101:bash.0 Request processed in 865us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541050.379788:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00080000:0.0:1788541050.379920:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541050.385162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541050.385205:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945345152 00000100:00100000:2.0:1788541050.385215:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945345152 00000100:00100000:2.0:1788541050.385266:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541050.385276:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:10278:x1875420945345152:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541050.385304:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541050.385323:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac160d expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.385354:0:9248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.385364:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541050.385368:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541050.385374:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 8 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.385421:0:9248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.385448:0:9248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 8 pid: 6704 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541050.385479:0:9248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968450560:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541050.385578:0:9248:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541050.391694:0:9248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968450560:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541050.391699:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:0.0:1788541050.391730:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 8 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541050.391732:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945345280 00000100:00100000:3.0:1788541050.391738:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945345280 00010000:00010000:0.0:1788541050.391751:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602400, rc 0) 00010000:00010000:3.0:1788541050.391771:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 9 pid: 6704 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541050.391804:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:10278:x1875420945345152:12345-192.168.202.59@tcp:101:bash.0 Request processed in 6530us (6653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541050.391812:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1788541050.391813:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1788541050.391822:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945345280:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541050.391834:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541050.391859:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 8 pid: 6704 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.391873:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 8 pid: 6704 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.391901:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000409c12f0/0xc9a6a13d3cd1ad82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1606 expref: 8 pid: 6704 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.391917:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541050.391921:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541050.391929:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.391951:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.391982:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541050.391995:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875420968450688:192.168.202.59@tcp:105: 00000100:00100000:3.0:1788541050.392050:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541050.398855:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875420968450688:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541050.398855:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:3.0:1788541050.398881:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541050.398932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945345280:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 7110us (7233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541050.398944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:1.0:1788541050.399495:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945345536 00000100:00100000:1.0:1788541050.399503:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945345536 00000100:00100000:1.0:1788541050.399555:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1788541050.399565:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+13:10278:x1875420945345536:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:1.0:1788541050.399873:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+14:10278:x1875420945345536:12345-192.168.202.59@tcp:35:bash.0 Request processed in 309us (1027us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788541050.399881:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000001:00080000:0.0:1788541050.404722:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:3.0:1788541050.455940:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541050.480378:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.480600:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945345792 00000100:00100000:3.0:1788541050.480612:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945345792 00000100:00100000:3.0:1788541050.480678:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:3.0:1788541050.480689:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+12:10288:x1875420945345792:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541050.480713:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541050.480735:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1ad90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1614 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541050.480838:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788541050.480965:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1ad90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1614 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.480992:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541050.480996:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541050.481002:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1ad90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1614 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.481016:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc800, rc 0) 00000100:00100000:3.0:1788541050.481143:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:10288:x1875420945345792:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 455us (773us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788541050.481150:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:2.0:1788541050.488983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541050.489115:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945346048 00000100:00100000:0.0:1788541050.489126:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945346048 00000100:00100000:0.0:1788541050.489198:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1788541050.489209:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:10288:x1875420945346048:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541050.489973:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:10288:x1875420945346048:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 763us (999us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788541050.489981:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1788541050.565124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541050.565591:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945346176 00000100:00100000:2.0:1788541050.565602:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945346176 00000100:00100000:2.0:1788541050.565661:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1788541050.565672:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+14:10294:x1875420945346176:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541050.565699:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541050.565720:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1ad9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac161b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.565798:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1ada5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.565813:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.565824:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541050.565859:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788541050.565862:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541050.565889:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1ada5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.565936:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1ad9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac161b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.565955:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1ada5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac161b expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.565963:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:2.0:1788541050.565966:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541050.565970:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602600, rc 0) 00000100:00100000:2.0:1788541050.566084:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+15:10294:x1875420945346176:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 414us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541050.566091:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1788541050.573031:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.575864:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945346432 00000100:00100000:3.0:1788541050.575883:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945346432 00000100:00100000:3.0:1788541050.576001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:3.0:1788541050.576014:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+15:10294:x1875420945346432:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541050.576037:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541050.576061:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1adac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1622 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.576176:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.576192:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.576204:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541050.576216:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788541050.576387:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1adac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1622 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.576579:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1622 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.576592:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:3.0:1788541050.576596:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541050.576599:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc600, rc 0) 00000100:00100000:3.0:1788541050.576802:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+17:10294:x1875420945346432:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 788us (3778us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788541050.576810:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:0.0:1788541050.581995:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541050.582088:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.582165:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945346816 00000100:00100000:3.0:1788541050.582176:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945346816 00000100:00100000:3.0:1788541050.582258:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1788541050.582272:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+17:2361:x1875420945346816:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541050.582288:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541050.582498:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1622 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.582521:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:3.0:1788541050.582527:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541050.582594:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+16:2361:x1875420945346816:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 324us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541050.582601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1788541050.583885:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945346688 00000100:00100000:2.0:1788541050.583898:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945346688 00000100:00100000:2.0:1788541050.584051:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:2.0:1788541050.584062:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+16:10294:x1875420945346688:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541050.584085:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541050.584104:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1adc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1629 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.584206:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1adc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.584220:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1adc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.584247:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1adc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541050.584273:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788541050.587613:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1adc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1629 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.587644:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1adc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1629 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.587665:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:2.0:1788541050.587668:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788541050.587672:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541050.587753:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+18:10294:x1875420945346688:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 3693us (5768us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788541050.587762:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:0.0:1788541050.592860:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.593116:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945346944 00000100:00100000:3.0:1788541050.593139:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945346944 00000100:00100000:3.0:1788541050.593222:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1788541050.593233:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945346944:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:3.0:1788541050.593280:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.593316:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.593326:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541050.593330:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541050.593335:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.593371:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.593384:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 7 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541050.593399:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875420968450816:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541050.593519:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541050.597521:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875420968450816:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541050.597553:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541050.597807:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541050.597887:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945347072 00000100:00100000:1.0:1788541050.597895:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945347072 00002000:00100000:1.0:1788541050.597942:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98d784c1f100 x1875420945347072/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:421/0 lens 504/0 e 0 to 0 dl 1788541061 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541050.597952:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d784c1f100 with x1875420945347072 ext(0->12) 00010000:00010000:1.0:1788541050.597960:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 8 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.597975:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 8 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541050.597983:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d784c1f100 00000100:00100000:1.0:1788541050.598017:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1788541050.598036:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945347072:12345-192.168.202.59@tcp:4:lfs.0 00000001:00100000:3.0:1788541050.634091:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000100:00100000:1.0:1788541050.634758:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:2359:x1875420945347072:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 36717us (36946us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788541050.634771:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00002000:00100000:1.0:1788541050.634784:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff98d784c1f100 x1875420945347072/t4294967299(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:421/0 lens 504/448 e 0 to 0 dl 1788541061 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541050.634795:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d784c1f100 with x1875420945347072 ext(0->12) 00010000:00010000:1.0:1788541050.634807:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 9 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.634824:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 9 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541050.634833:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d784c1f100 00000100:00100000:0.0:1788541050.636614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.636813:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945347200 00000100:00100000:3.0:1788541050.636822:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945347200 00010000:00010000:3.0:1788541050.636859:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 9 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541050.636892:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1788541050.636901:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:2360:x1875420945347200:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541050.636917:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788541050.636935:0:6720:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788541050.636937:0:6720:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788541050 00002000:00010000:3.0:1788541050.636939:0:6720:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788541050 00002000:00010000:3.0:1788541050.636940:0:6720:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788541050 00010000:00010000:3.0:1788541050.636945:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 9 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.637083:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 9 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.637100:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1ad89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac160d expref: 9 pid: 9248 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.637113:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541050.637117:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541050.637121:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.637137:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.637186:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541050.637248:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2360:x1875420945347200:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 347us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541050.637256:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00010000:00010000:1.0:1788541050.637331:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637341:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637366:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637374:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637554:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637561:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541050.637566:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637575:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637590:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.637597:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f26962bf/0xc9a6a13d3cd1add6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541050.637644:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945346944:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 44414us (44795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541050.637666:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1788541050.639748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541050.639838:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945347456 00000100:00100000:1.0:1788541050.639847:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945347456 00000100:00100000:1.0:1788541050.639906:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:1.0:1788541050.639916:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+18:10294:x1875420945347456:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:1.0:1788541050.640074:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1adc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1629 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541050.640619:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788541050.640658:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788541050.641092:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788541050.641160:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.641175:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 22 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.641184:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.642093:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 22 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.642110:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 22 pid: 9724 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541050.642136:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875420968450944:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541050.642308:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541050.644574:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875420968450944:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541050.644606:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541050.647337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541050.647550:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945347584 00000100:00100000:0.0:1788541050.647560:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945347584 00010000:00010000:0.0:1788541050.647603:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 23 pid: 9724 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541050.647644:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:0.0:1788541050.647654:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:2358:x1875420945347584:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541050.647670:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541050.647677:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 23 pid: 9724 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.647691:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 23 pid: 9724 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.647734:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1ad6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ff expref: 23 pid: 9724 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.647751:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:0.0:1788541050.647756:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.647766:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.647773:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.647815:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541050.647875:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+22:2358:x1875420945347584:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 223us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541050.647882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00010000:00010000:1.0:1788541050.647945:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.647953:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541050.648113:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788541050.648338:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788541050.648611:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968451072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788541050.649282:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541050.649497:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968451072 00000100:00100000:3.0:1788541050.649504:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968451072 00000100:00100000:1.0:1788541050.649642:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78133a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541050.649854:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541050.649864:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7899b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875420968451072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788541050.649879:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541050.649952:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7899b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875420968451072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541050.649959:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541050.650023:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968451072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788541050.650765:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788541050.650836:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968451200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788541050.650880:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541050.653873:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541050.655886:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968451200 00000100:00100000:2.0:1788541050.655901:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968451200 00000100:00100000:2.0:1788541050.655966:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541050.655976:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875420968451200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541050.656731:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875420968451200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 754us (5848us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788541050.656742:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541050.657587:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7899b1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968451200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788541050.657662:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788541050.657721:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.657732:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.657963:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.657971:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541050.657976:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.657984:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.658016:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:1.0:1788541050.658019:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788541050.658024:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541050.658028:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1addd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541050.658270:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788541050.658607:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788541050.658616:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335658206694ns, next at 336658204842ns, rc = 0 00000001:00080000:1.0:1788541050.658623:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788541050.658651:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:1.0:1788541050.658654:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788541050.658662:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1adc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1629 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541050.658852:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+25:10294:x1875420945347456:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 18867us (19042us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788541050.658862:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000020:00080000:1.0:1788541050.658868:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788541050.661926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541050.661976:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945347712 00000100:00100000:0.0:1788541050.661987:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945347712 00000100:00100000:0.0:1788541050.662087:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1788541050.662099:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+25:10294:x1875420945347712:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541050.662122:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541050.662159:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1ade4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1630 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.662233:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1ade4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1630 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.662263:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1ade4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1630 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.662284:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541050.662287:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541050.662302:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6200, rc 0) 00000100:00100000:0.0:1788541050.662360:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+26:10294:x1875420945347712:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 264us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541050.662367:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:2.0:1788541050.666395:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.666605:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945347968 00000100:00100000:3.0:1788541050.666614:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945347968 00000100:00100000:3.0:1788541050.666705:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1788541050.666717:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+26:10294:x1875420945347968:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541050.666970:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+27:10294:x1875420945347968:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 254us (584us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788541050.666978:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1788541050.749628:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.749724:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945348224 00000100:00100000:3.0:1788541050.749735:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945348224 00000100:00100000:3.0:1788541050.749804:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:3.0:1788541050.749816:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+27:10304:x1875420945348224:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541050.749839:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541050.749861:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1637 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541050.749966:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788541050.750095:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adeb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1637 expref: 29 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.750110:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541050.750113:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541050.750119:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1adeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1637 expref: 29 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.750144:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc600, rc 0) 00000100:00100000:3.0:1788541050.750507:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+28:10304:x1875420945348224:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 692us (886us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788541050.750514:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:2.0:1788541050.754630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541050.754713:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945348352 00000100:00100000:3.0:1788541050.754722:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945348352 00000100:00100000:3.0:1788541050.754772:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1788541050.754788:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:10304:x1875420945348352:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:3.0:1788541050.754859:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.754875:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.754886:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.754900:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.754912:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.754919:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.754999:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755006:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755013:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541050.755051:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755064:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755070:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755077:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755082:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.755086:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755094:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755110:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541050.755113:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.755117:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755135:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1adf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755148:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755154:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755160:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755165:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.755167:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755173:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755179:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78320db00) 00010000:00010000:3.0:1788541050.755181:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.755184:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755189:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755210:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755216:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755222:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755226:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541050.755229:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755608:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755616:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541050.755619:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541050.755622:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541050.755628:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541050.755755:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:10304:x1875420945348352:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 972us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541050.755763:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:0.0:1788541050.757992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541050.758079:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945348608 00000100:00100000:1.0:1788541050.758087:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945348608 00000100:00100000:1.0:1788541050.758151:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1788541050.758161:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+28:10304:x1875420945348608:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1788541050.758447:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:10304:x1875420945348608:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 287us (461us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788541050.758467:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1788541050.791506:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541050.791647:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945348864 00000100:00100000:2.0:1788541050.791658:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945348864 00000100:00100000:2.0:1788541050.791724:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1788541050.791734:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+29:10307:x1875420945348864:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541050.791757:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541050.791778:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac163e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792027:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792043:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792054:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792069:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792076:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792081:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792204:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792232:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792239:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541050.792250:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788541050.792357:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792366:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792373:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792379:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541050.792383:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792392:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792403:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:2.0:1788541050.792445:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541050.792452:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792459:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792472:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792484:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792490:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792494:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541050.792497:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792504:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792512:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d786553500) 00010000:00010000:2.0:1788541050.792515:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541050.792518:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792525:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792567:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792579:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541050.792586:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541050.792589:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541050.792596:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602200, rc 0) 00000100:00100000:2.0:1788541050.792648:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+31:10307:x1875420945348864:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 914us (1151us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788541050.792656:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1788541050.795649:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541050.795725:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945348992 00000100:00100000:0.0:1788541050.795734:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945348992 00000100:00100000:0.0:1788541050.795791:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1788541050.795801:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+31:10307:x1875420945348992:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1788541050.795865:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795881:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795892:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795916:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795922:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795942:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795947:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541050.795951:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795958:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795970:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541050.795973:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541050.795978:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541050.795985:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1ae31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541050.796093:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+31:10307:x1875420945348992:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 292us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541050.796100:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1788541050.799979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541050.800080:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945349248 00000100:00100000:1.0:1788541050.800091:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945349248 00000100:00100000:1.0:1788541050.800189:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1788541050.800200:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+31:10307:x1875420945349248:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1788541050.800565:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:10307:x1875420945349248:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 367us (596us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788541050.800573:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1788541051.003811:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541051.003866:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.003959:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945349376 00000100:00100000:2.0:1788541051.003970:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945349376 00000100:00100000:2.0:1788541051.004027:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 287 00000100:00100000:2.0:1788541051.004037:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945349376:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541051.004116:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945349376:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.004139:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 287 00000100:00100000:3.0:1788541051.004388:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945349504 00000100:00100000:3.0:1788541051.004393:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945349504 00000100:00080000:1.0:1788541051.004463:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541051.004485:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:3.0:1788541051.004494:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945349504:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541051.004543:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2360:x1875420945349504:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 50us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541051.004566:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:0.0:1788541051.033597:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.033673:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945349760 00000100:00100000:3.0:1788541051.033684:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945349760 00000100:00100000:3.0:1788541051.033751:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1788541051.033762:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:10338:x1875420945349760:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:3.0:1788541051.033789:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541051.033812:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1645 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.033919:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.033934:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.033948:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541051.033958:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788541051.034179:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1645 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.034199:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1645 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.034208:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.034212:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541051.034215:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd000, rc 0) 00000100:00100000:3.0:1788541051.034538:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+34:10338:x1875420945349760:12345-192.168.202.59@tcp:101:cat.0 Request processed in 776us (948us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788541051.034546:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:1.0:1788541051.037560:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.037644:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945350016 00000100:00100000:3.0:1788541051.037655:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945350016 00000100:00100000:3.0:1788541051.037714:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788541051.037725:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+34:10338:x1875420945350016:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:3.0:1788541051.038483:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:10338:x1875420945350016:12345-192.168.202.59@tcp:35:cat.0 Request processed in 757us (931us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788541051.038492:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1788541051.044573:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.044669:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945350144 00000100:00100000:2.0:1788541051.044680:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945350144 00000100:00100000:2.0:1788541051.044747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1788541051.044757:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78316dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:2360:x1875420945350144:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541051.044776:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541051.044877:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1ae3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1645 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.044900:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541051.044905:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541051.044966:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78316dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+34:2360:x1875420945350144:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 211us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.044974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:0.0:1788541051.098660:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.098753:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945350400 00000100:00100000:3.0:1788541051.098763:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945350400 00000100:00100000:3.0:1788541051.098826:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1788541051.098837:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+34:10344:x1875420945350400:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:3.0:1788541051.098863:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541051.098867:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788541051.098892:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1ada5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac161b expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.098914:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541051.098919:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541051.098934:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac164c expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.099058:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.099071:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.099087:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.099118:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.099154:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 34 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541051.099165:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968451328:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541051.099238:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7811ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541051.102607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541051.102676:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945350528 00000100:00100000:0.0:1788541051.102684:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945350528 00010000:00010000:0.0:1788541051.102727:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 35 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541051.102776:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:0.0:1788541051.102785:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:2358:x1875420945350528:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541051.102800:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541051.102807:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 35 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.102819:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 35 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.102842:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541051.102845:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.102853:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.102858:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.102874:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541051.102921:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:2358:x1875420945350528:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 139us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.102926:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00010000:00010000:3.0:1788541051.103542:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1ae23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac163e expref: 34 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541051.103563:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968451328:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541051.103592:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.103606:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.103613:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541051.103632:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788541051.103815:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 35 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.103852:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 34 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.103860:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.103863:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541051.103866:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc200, rc 0) 00000100:00100000:3.0:1788541051.103964:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+34:10344:x1875420945350400:12345-192.168.202.59@tcp:101:dd.0 Request processed in 5129us (5314us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788541051.103973:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:1.0:1788541051.106767:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.106923:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945350784 00000100:00100000:2.0:1788541051.106933:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945350784 00000100:00100000:2.0:1788541051.107010:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:2.0:1788541051.107022:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+34:10344:x1875420945350784:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:2.0:1788541051.107562:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.107581:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.107593:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541051.107649:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788541051.107677:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b69390d3 reply state 00000000fb179e7e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.107686:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541051.107871:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+37:10344:x1875420945350784:12345-192.168.202.59@tcp:36:dd.0 Request processed in 850us (1113us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788541051.107879:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000020:00080000:2.0:1788541051.107885:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541051.117913:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.117933:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.117940:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.117946:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541051.117951:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.117958:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.117976:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.117979:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541051.117984:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.118011:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1ae62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541051.397878:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.398005:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945350912 00000100:00100000:2.0:1788541051.398016:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945350912 00000100:00100000:2.0:1788541051.398089:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:2.0:1788541051.398101:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+36:10358:x1875420945350912:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:2.0:1788541051.398136:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541051.398163:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1653 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398235:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398267:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398281:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398558:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398566:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398574:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398666:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398678:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 37 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398686:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398717:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 37 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.398730:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 37 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.398756:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968451456:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541051.399017:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541051.401535:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.401602:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968451456:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541051.401633:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541051.401697:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945351168 00000100:00100000:3.0:1788541051.401704:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945351168 00000100:00100000:3.0:1788541051.401763:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1788541051.401772:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+38:9232:x1875420945351168:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788541051.402244:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+39:9232:x1875420945351168:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 470us (717us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788541051.402252:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1788541051.408007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.408110:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945351296 00000100:00100000:2.0:1788541051.408144:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945351296 00010000:00010000:2.0:1788541051.408186:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 39 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.408279:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1788541051.408301:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+39:2360:x1875420945351296:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541051.408318:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541051.408325:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 39 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.408338:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 39 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.408360:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ae54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac164c expref: 39 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.408376:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541051.408382:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.408404:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.408460:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.408494:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541051.408545:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+38:2360:x1875420945351296:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 245us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.408552:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00010000:00010000:1.0:1788541051.409277:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409296:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541051.409341:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788541051.409345:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541051.409387:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409401:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409454:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409461:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409468:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409473:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541051.409477:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409485:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409496:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541051.409498:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541051.409503:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409508:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1ae70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409521:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409527:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409533:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409545:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541051.409548:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409554:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409561:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d786553500) 00010000:00010000:1.0:1788541051.409563:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541051.409565:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409571:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1ae77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409607:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603000/0xc9a6a13d3cd1ae69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1653 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409619:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1653 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541051.409626:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:1.0:1788541051.409628:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541051.409631:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603800, rc 0) 00000100:00100000:1.0:1788541051.409667:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+37:10358:x1875420945350912:12345-192.168.202.59@tcp:101:stat.0 Request processed in 11570us (11801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.409674:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:1.0:1788541051.477736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.477822:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945351552 00000100:00100000:3.0:1788541051.477830:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945351552 00000100:00100000:3.0:1788541051.477878:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1788541051.477886:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+37:10364:x1875420945351552:12345-192.168.202.59@tcp:36:truncate.0 00010000:00010000:3.0:1788541051.477936:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541051.477957:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1ae7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1653 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.477972:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.477976:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541051.478617:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.478630:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.478638:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541051.478684:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788541051.478703:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000559a9e42 reply state 00000000e94e8765 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541051.478709:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541051.478853:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+39:10364:x1875420945351552:12345-192.168.202.59@tcp:36:truncate.0 Request processed in 966us (1125us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788541051.478859:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000020:00080000:3.0:1788541051.478863:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788541051.482700:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541051.489814:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.489831:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.489839:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.489844:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541051.489849:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.489857:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.489873:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541051.489877:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541051.489881:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.489905:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ae85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541051.630755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.634296:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945351680 00000100:00100000:3.0:1788541051.634314:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945351680 00000100:00100000:3.0:1788541051.634396:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:3.0:1788541051.634434:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+38:10379:x1875420945351680:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:3.0:1788541051.634460:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541051.634482:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1ae8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac165a expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634539:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634551:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634561:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634570:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634589:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634594:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634665:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634670:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634674:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541051.634701:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788541051.634705:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541051.634722:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634731:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634737:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634741:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634745:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634755:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cda00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541051.634759:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634764:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634773:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541051.634776:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541051.634780:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634787:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1ae93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634800:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634806:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634811:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634816:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541051.634819:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634825:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634842:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78320db00) 00010000:00010000:3.0:1788541051.634844:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541051.634846:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634850:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ae9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634872:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1ae8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 40 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634881:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 39 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.634885:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.634887:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541051.634888:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4ccc00, rc 0) 00000100:00100000:3.0:1788541051.634949:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+39:10379:x1875420945351680:12345-192.168.202.59@tcp:101:stat.0 Request processed in 545us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541051.634956:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:1.0:1788541051.722919:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.723163:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945351936 00000100:00100000:2.0:1788541051.723174:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945351936 00000100:00100000:3.0:1788541051.723271:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:3.0:1788541051.723295:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+39:10389:x1875420945351936:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541051.723323:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541051.723347:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1661 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541051.723501:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788541051.723641:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aea8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1661 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.723661:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541051.723664:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541051.723671:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1661 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.723687:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc600, rc 0) 00000100:00100000:3.0:1788541051.723744:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+40:10389:x1875420945351936:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 463us (833us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788541051.723751:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1788541051.725528:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541051.725599:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945352192 00000100:00100000:0.0:1788541051.725607:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945352192 00000100:00100000:0.0:1788541051.725657:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1788541051.725675:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+40:10389:x1875420945352192:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541051.725853:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+41:10389:x1875420945352192:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 179us (332us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788541051.725859:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1788541051.803305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.803596:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945352448 00000100:00100000:2.0:1788541051.803607:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945352448 00000100:00100000:2.0:1788541051.803670:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:2.0:1788541051.803680:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+41:10395:x1875420945352448:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541051.803705:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541051.803727:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aeb6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1668 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.803824:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.803839:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 42 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.803848:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.803881:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 42 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.803895:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 42 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.803909:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968451584:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541051.804041:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541051.808071:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541051.808307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945352576 00000100:00100000:0.0:1788541051.808316:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945352576 00010000:00010000:0.0:1788541051.808361:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 43 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541051.808486:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:0.0:1788541051.808498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+43:2358:x1875420945352576:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541051.808512:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541051.808527:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 43 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.808540:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 43 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.808561:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541051.808566:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.808575:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.808583:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.808620:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541051.808674:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+43:2358:x1875420945352576:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 178us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.808681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00010000:00010000:2.0:1788541051.808788:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1aea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac165a expref: 42 pid: 9724 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.808804:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968451584:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541051.808825:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.808834:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.808838:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541051.808857:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788541051.809170:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aeb6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.809188:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.809194:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541051.809197:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541051.809199:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603400, rc 0) 00000100:00100000:2.0:1788541051.809247:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+42:10395:x1875420945352448:12345-192.168.202.59@tcp:101:bash.0 Request processed in 5568us (5953us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788541051.809254:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1788541051.814541:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.814637:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945352832 00000100:00100000:2.0:1788541051.814662:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945352832 00000100:00100000:2.0:1788541051.814709:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:2.0:1788541051.814716:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+42:10395:x1875420945352832:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1788541051.814965:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.814982:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.814994:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541051.815048:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788541051.815085:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afa44c37 reply state 00000000324d6af3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.815094:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541051.815190:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+45:10395:x1875420945352832:12345-192.168.202.59@tcp:36:bash.0 Request processed in 473us (660us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788541051.815195:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000020:00080000:2.0:1788541051.815199:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541051.818478:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.818497:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.818505:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.818522:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541051.818528:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.818536:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.818554:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.818557:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541051.818579:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.818586:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1aecb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541051.821007:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.825624:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945352960 00000100:00100000:3.0:1788541051.825639:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945352960 00000100:00100000:3.0:1788541051.825715:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:3.0:1788541051.825726:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+44:10395:x1875420945352960:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541051.825749:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541051.825775:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac166f expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.825858:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.825874:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.825899:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.825938:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.825952:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 45 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541051.825967:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968451712:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541051.826097:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7812edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541051.831370:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.831724:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968451712:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541051.831753:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541051.831878:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945353088 00000100:00100000:0.0:1788541051.831897:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945353088 00010000:00010000:0.0:1788541051.831937:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 46 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541051.831978:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:0.0:1788541051.831988:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+46:2360:x1875420945353088:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541051.832011:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541051.832019:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 46 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.832033:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 46 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.832054:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aebd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1668 expref: 46 pid: 5852 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.832070:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541051.832074:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.832084:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.832103:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.832273:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541051.832335:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+45:2360:x1875420945353088:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 348us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.832343:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00010000:00010000:3.0:1788541051.832786:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.832797:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541051.832844:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788541051.832849:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541051.832871:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.832903:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac166f expref: 45 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.832970:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac166f expref: 44 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.832979:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541051.832983:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541051.832986:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd600, rc 0) 00000100:00100000:3.0:1788541051.833038:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+44:10395:x1875420945352960:12345-192.168.202.59@tcp:101:bash.0 Request processed in 7313us (12040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541051.833046:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:1.0:1788541051.844685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541051.844751:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945353344 00000100:00100000:0.0:1788541051.844760:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945353344 00000100:00100000:0.0:1788541051.844862:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1788541051.844871:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+44:10395:x1875420945353344:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1788541051.845105:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+45:10395:x1875420945353344:12345-192.168.202.59@tcp:35:bash.0 Request processed in 234us (426us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788541051.845113:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000004:00080000:1.0:1788541051.863818:0:6854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336863405556ns, next at 337863403336ns, rc = 0 00000100:00100000:2.0:1788541051.864487:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968451840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541051.864559:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541051.864930:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968451840 00000100:00100000:3.0:1788541051.864953:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968451840 00000100:00100000:3.0:1788541051.865018:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788541051.865028:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968451840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541051.865053:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541051.865124:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968451840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541051.865132:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788541051.865207:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968451840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541051.932762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.932921:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945353600 00000100:00100000:2.0:1788541051.932933:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945353600 00000100:00100000:3.0:1788541051.933206:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:3.0:1788541051.933221:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+45:10405:x1875420945353600:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541051.933249:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541051.933272:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541051.933388:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788541051.933859:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aee0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1676 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.933875:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541051.933878:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541051.933895:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1aee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1676 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541051.933911:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc600, rc 0) 00000100:00100000:3.0:1788541051.933983:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+46:10405:x1875420945353600:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 766us (1232us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788541051.933990:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:1.0:1788541051.937513:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541051.938230:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945353728 00000100:00100000:2.0:1788541051.938242:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945353728 00000100:00100000:2.0:1788541051.938314:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:2.0:1788541051.938325:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+46:10405:x1875420945353728:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:2.0:1788541051.938455:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938486:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938499:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938743:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938753:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938760:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938855:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938864:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938871:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541051.938918:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938932:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938939:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938957:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938962:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541051.938966:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938974:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.938986:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:2.0:1788541051.938989:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541051.938995:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939144:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1aeee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939160:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939167:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939172:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939177:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541051.939180:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939196:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939204:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d786553000) 00010000:00010000:2.0:1788541051.939207:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541051.939210:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939216:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1aef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939231:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939238:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939244:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939249:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541051.939252:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939257:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939265:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541051.939267:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541051.939270:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541051.939400:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1aefc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541051.939757:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+46:10405:x1875420945353728:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1429us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.939767:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1788541051.943975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541051.944051:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945353984 00000100:00100000:3.0:1788541051.944083:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945353984 00000100:00100000:3.0:1788541051.944142:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1788541051.944152:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+46:10405:x1875420945353984:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541051.944448:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+47:10405:x1875420945353984:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 295us (482us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788541051.944457:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1788541051.996849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541051.997230:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945354240 00000100:00100000:0.0:1788541051.997241:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945354240 00000100:00100000:0.0:1788541051.997317:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:0.0:1788541051.997328:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+47:10408:x1875420945354240:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541051.997360:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541051.997382:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1af03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac167d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997498:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997524:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997551:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997568:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997575:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997581:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997719:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1af18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997729:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1af18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997737:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1af18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541051.997745:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788541051.997844:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997853:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997860:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997865:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541051.997876:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997898:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997911:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541051.997914:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541051.997919:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997926:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997940:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997946:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997951:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997956:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541051.997959:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997965:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997971:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78b22be00) 00010000:00010000:0.0:1788541051.997973:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541051.997989:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.997996:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.998875:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1af03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac167d expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.998894:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1af18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac167d expref: 49 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541051.998901:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541051.998904:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541051.998906:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6400, rc 0) 00000100:00100000:0.0:1788541051.998977:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+49:10408:x1875420945354240:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1650us (2138us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788541051.998985:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:1.0:1788541052.003818:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541052.003866:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541052.003951:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945354496 00000100:00100000:2.0:1788541052.003961:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945354496 00000100:00100000:2.0:1788541052.004038:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:2.0:1788541052.004048:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+49:10408:x1875420945354496:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1788541052.004125:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004142:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004156:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004182:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004190:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004197:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004203:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541052.004207:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004230:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004242:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:2.0:1788541052.004245:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541052.004250:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541052.004257:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1af26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541052.004332:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+49:10408:x1875420945354496:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 285us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541052.004340:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00080000:1.0:1788541052.004742:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541052.006068:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945354368 00000100:00100000:3.0:1788541052.006080:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945354368 00000100:00100000:3.0:1788541052.006159:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:3.0:1788541052.006170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+49:2360:x1875420945354368:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541052.006183:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541052.006203:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1af18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac167d expref: 49 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.006221:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541052.006227:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541052.006618:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+48:2360:x1875420945354368:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 447us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541052.006733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:1.0:1788541052.013870:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541052.013980:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945354752 00000100:00100000:3.0:1788541052.013990:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945354752 00000100:00100000:3.0:1788541052.014039:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1788541052.014048:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+48:10408:x1875420945354752:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541052.014596:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+49:10408:x1875420945354752:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 547us (735us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788541052.014606:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541052.202169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541052.202262:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945355008 00000100:00100000:0.0:1788541052.202273:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945355008 00000100:00100000:0.0:1788541052.202340:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:0.0:1788541052.202351:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+49:10426:x1875420945355008:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:0.0:1788541052.202374:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541052.202396:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1af2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1684 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.202522:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.202554:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.202567:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541052.202580:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788541052.202711:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1af2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1684 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.202730:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1684 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.202738:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:0.0:1788541052.202740:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788541052.202744:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7e00, rc 0) 00000100:00100000:0.0:1788541052.203230:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+51:10426:x1875420945355008:12345-192.168.202.59@tcp:101:cat.0 Request processed in 878us (1067us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788541052.203724:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:2.0:1788541052.239641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541052.239861:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945355136 00000100:00100000:3.0:1788541052.239872:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945355136 00000100:00100000:3.0:1788541052.239935:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:3.0:1788541052.239947:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+51:10427:x1875420945355136:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541052.239971:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541052.239992:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac168b expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.240076:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1af49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.240092:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1af49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.240105:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1af49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541052.240148:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788541052.240152:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541052.240171:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1af49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.240195:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac168b expref: 53 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.240214:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1af49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac168b expref: 52 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.240223:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541052.240226:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541052.240254:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cda00, rc 0) 00000100:00100000:3.0:1788541052.240697:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+52:10427:x1875420945355136:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 750us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541052.240705:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:1.0:1788541052.248200:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541052.248275:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945355520 00000100:00100000:3.0:1788541052.248290:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945355520 00000100:00100000:3.0:1788541052.248340:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1788541052.248349:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:10427:x1875420945355520:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541052.248687:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+53:10427:x1875420945355520:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 338us (496us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788541052.248695:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:0.0:1788541052.255036:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541052.255140:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945355648 00000100:00100000:3.0:1788541052.255150:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945355648 00000100:00100000:3.0:1788541052.255221:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:3.0:1788541052.255241:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+53:10427:x1875420945355648:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:3.0:1788541052.255257:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788541052.255292:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1aed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac166f expref: 53 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.255313:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1af34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1684 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.255323:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1ade4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1630 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541052.255332:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22b500) 00010000:00010000:3.0:1788541052.255344:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541052.255473:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+50:10427:x1875420945355648:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 242us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541052.255481:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1788541052.258511:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541052.258614:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945355776 00000100:00100000:0.0:1788541052.258626:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945355776 00000100:00100000:0.0:1788541052.258685:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:0.0:1788541052.258695:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+50:10427:x1875420945355776:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:0.0:1788541052.258830:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.258847:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.258864:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541052.259191:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541052.259356:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788541052.259467:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788541052.259575:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+50:10427:x1875420945355776:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 880us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541052.259585:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:1.0:1788541052.283161:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541052.283288:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945355904 00000100:00100000:0.0:1788541052.283298:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945355904 00000100:00100000:0.0:1788541052.283360:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:0.0:1788541052.283378:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+50:10429:x1875420945355904:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541052.283401:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541052.283452:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1692 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283543:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283557:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283568:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283585:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283604:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283611:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283698:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283707:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283714:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541052.283748:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788541052.283752:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541052.283772:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283784:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283793:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283800:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283807:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283822:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541052.283827:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283835:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283847:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541052.283850:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541052.283856:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283863:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283877:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283883:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283888:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283893:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541052.283895:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283901:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283918:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78b22bc00) 00010000:00010000:0.0:1788541052.283921:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541052.283923:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283928:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283958:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283970:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541052.283977:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:0.0:1788541052.283979:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541052.283981:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7800, rc 0) 00000100:00100000:0.0:1788541052.284049:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+51:10429:x1875420945355904:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 680us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541052.284057:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00010000:00010000:0.0:1788541052.503578:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541052.893371:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788541052.893473:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541052.893529:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788541052.893536:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788541052.893566:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541052.893591:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968452480:0@lo:400:kworker.0 00000100:00100000:2.0:1788541052.893616:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541052.893648:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968452352 00000100:00100000:2.0:1788541052.893656:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968452352 00000100:00100000:2.0:1788541052.893716:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788541052.893726:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541052.893790:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968452352:12345-0@lo:400:kworker.0 Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541052.893798:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788541052.893821:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541052.893849:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968452352:0@lo:400:kworker.0 00000100:00100000:0.0:1788541052.896570:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968452096:0@lo:400:kworker.0 00000100:00100000:0.0:1788541052.896640:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541052.896735:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968452608:0@lo:400:kworker.0 00000100:00100000:0.0:1788541052.896763:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541052.896798:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541052.896804:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968452224:0@lo:400:kworker.0 00000100:00100000:0.0:1788541052.896837:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541052.896878:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968452608 00000100:00100000:2.0:1788541052.896887:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968452608 00000100:00100000:2.0:1788541052.896948:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788541052.896957:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541052.897008:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968452608:12345-0@lo:400:kworker.0 Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541052.897015:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788541052.897043:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541052.905026:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968451968 00000100:00100000:1.0:1788541052.905043:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968451968 00000100:00100000:1.0:1788541052.905137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788541052.905148:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968451968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541052.905244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3314:x1875420968451968:12345-0@lo:400:kworker.0 Request processed in 99us (11676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541052.905252:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788541052.905649:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968452608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541052.905810:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968451968:0@lo:400:kworker.0 00000100:00100000:3.0:1788541052.908631:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968452480 00000100:00100000:3.0:1788541052.908648:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968452480 00000100:00080000:3.0:1788541052.908696:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541052.908754:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968452096 00000100:00100000:3.0:1788541052.908759:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968452096 00000100:00100000:3.0:1788541052.908774:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968452224 00000100:00100000:3.0:1788541052.908777:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968452224 00000100:00100000:3.0:1788541052.908801:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788541052.908811:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968452480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541052.908908:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968452480:12345-0@lo:400:kworker.0 Request processed in 99us (15291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541052.908916:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788541052.908932:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788541052.908938:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968452096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541052.908974:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968452096:12345-0@lo:400:kworker.0 Request processed in 36us (12335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541052.908980:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788541052.908991:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788541052.908997:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968452224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541052.909024:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968452224:12345-0@lo:400:kworker.0 Request processed in 28us (12186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541052.909029:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788541052.909042:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541052.909085:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968452480:0@lo:400:kworker.0 00000100:00100000:3.0:1788541052.909153:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968452224:0@lo:400:kworker.0 00000100:00100000:3.0:1788541052.909165:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968452096:0@lo:400:kworker.0 00000040:00080000:0.0:1788541052.986748:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541052.986757:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541052.986810:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788541052.986815:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788541053.207767:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541053.207778:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541053.207839:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788541053.207846:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541053.209307:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78904e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968452736:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541053.209456:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788541053.221000:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.221941:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78904e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968452736:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541053.222182:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945356032 00000100:00100000:2.0:1788541053.222190:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945356032 00000100:00100000:2.0:1788541053.222294:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1788541053.222305:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356032:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788541053.222393:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356032:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 Request processed in 89us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.222401:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:2.0:1788541053.243453:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.243728:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945356160 00000100:00100000:3.0:1788541053.243739:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945356160 00000100:00100000:3.0:1788541053.243806:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:3.0:1788541053.243816:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356160:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788541053.243852:0:9724:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788541053.243961:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356160:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 145us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541053.243969:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:3.0:1788541053.247311:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.247470:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945356288 00000100:00100000:0.0:1788541053.247480:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945356288 00000100:00100000:0.0:1788541053.247540:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:0.0:1788541053.247550:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356288:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788541053.247619:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247635:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247648:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247664:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247690:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247698:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247725:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247734:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247741:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541053.247781:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788541053.247786:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541053.247799:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247811:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247818:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247825:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247831:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.247834:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247850:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247863:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:0.0:1788541053.247866:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541053.247870:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247877:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1af73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247891:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247897:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247902:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247907:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.247910:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247916:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247923:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff98d78b22b200) 00010000:00010000:0.0:1788541053.247926:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541053.247928:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247944:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1af7a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247961:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247966:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247972:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247977:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.247980:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247986:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.247993:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:0.0:1788541053.247995:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541053.247998:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.248003:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1af81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.248076:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356288:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 525us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.248083:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1788541053.260695:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.260890:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945356544 00000100:00100000:3.0:1788541053.260901:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945356544 00000100:00100000:3.0:1788541053.260963:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:3.0:1788541053.260974:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+51:10441:x1875420945356544:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541053.260996:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541053.261019:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1af88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1699 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261128:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261143:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261154:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541053.261173:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788541053.261289:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261297:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261303:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261308:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541053.261312:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261319:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261332:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:3.0:1788541053.261335:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541053.261339:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261345:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1af8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261387:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1af88 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1699 expref: 53 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261397:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:3.0:1788541053.261400:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541053.261463:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1af88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1699 expref: 53 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.261474:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd600, rc 0) 00000100:00100000:3.0:1788541053.261538:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+52:10441:x1875420945356544:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 565us (854us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788541053.261545:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:2.0:1788541053.266668:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.266765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945356672 00000100:00100000:0.0:1788541053.266776:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945356672 00000100:00100000:0.0:1788541053.266835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:0.0:1788541053.266846:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:10441:x1875420945356672:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541053.266878:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541053.266973:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:10441:x1875420945356672:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 129us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.266980:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:2.0:1788541053.274483:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.274743:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945356928 00000100:00100000:3.0:1788541053.274755:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945356928 00000100:00100000:3.0:1788541053.274817:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:3.0:1788541053.274828:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+52:10441:x1875420945356928:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541053.274848:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541053.274851:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788541053.274876:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1af49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac168b expref: 52 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.274896:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541053.274902:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541053.274914:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1af9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16a0 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541053.275319:0:9724:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788541053.275727:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1afa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.275742:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1afa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.275754:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1afa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.275824:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1af9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a0 expref: 54 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.275840:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1afa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a0 expref: 53 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.275848:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78320db00) 00010000:00010000:3.0:1788541053.275850:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541053.275853:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc600, rc 0) 00000100:00100000:3.0:1788541053.275919:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+53:10441:x1875420945356928:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1093us (1447us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788541053.275927:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:3.0:1788541053.279464:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.279625:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945357184 00000100:00100000:0.0:1788541053.279636:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945357184 00000100:00100000:0.0:1788541053.279697:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:0.0:1788541053.279709:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+53:10441:x1875420945357184:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541053.279781:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541053.279808:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1afa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a0 expref: 53 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.279827:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78320db00) 00010000:00010000:0.0:1788541053.279839:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541053.279865:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.279878:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.279888:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.279903:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.279926:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.279933:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280005:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280013:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280020:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280027:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.280031:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280039:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280047:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541053.280050:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541053.280054:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280060:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1afb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280069:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280082:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280088:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280093:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.280096:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280114:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280123:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe3cf1009 (ffff98d78b22b200) 00010000:00010000:0.0:1788541053.280126:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541053.280129:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.280135:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe3cf1009 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.280224:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:10441:x1875420945357184:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 517us (771us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541053.280231:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:2.0:1788541053.287202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.287325:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945357312 00000100:00100000:0.0:1788541053.287337:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945357312 00000100:00100000:0.0:1788541053.287401:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:0.0:1788541053.287440:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+52:10441:x1875420945357312:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541053.287464:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541053.287499:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16a7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.287538:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.287553:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.287565:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.287667:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.287687:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.287696:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:0.0:1788541053.287700:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541053.287703:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6a00, rc 0) 00000100:00100000:0.0:1788541053.287789:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+53:10441:x1875420945357312:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 378us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.287797:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:2.0:1788541053.290927:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.291076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945357568 00000100:00100000:0.0:1788541053.291088:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945357568 00000100:00100000:0.0:1788541053.291160:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 75 00000100:00100000:0.0:1788541053.291170:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+53:10441:x1875420945357568:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541053.291254:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.291301:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.291313:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541053.291662:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788541053.291673:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338291263789ns, next at 339291261421ns, rc = 0 00000004:00010000:0.0:1788541053.291758:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c29cf9a reply state 00000000aac4f50c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.291768:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541053.291854:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:10441:x1875420945357568:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 685us (937us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788541053.291861:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 75 00010000:00010000:2.0:1788541053.294478:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.294495:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.294503:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.294509:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541053.294514:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.294522:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.294539:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:2.0:1788541053.294542:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788541053.294547:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.294554:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1afce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541053.303273:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.303546:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945357696 00000100:00100000:0.0:1788541053.303557:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945357696 00000100:00100000:0.0:1788541053.303638:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:0.0:1788541053.303650:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+54:10441:x1875420945357696:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541053.303674:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541053.303698:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16ae expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.303775:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.303791:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.303837:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:0.0:1788541053.303842:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541053.303846:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7400, rc 0) 00000100:00100000:0.0:1788541053.303913:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+55:10441:x1875420945357696:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 266us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.303920:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:1.0:1788541053.310676:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.318172:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945357824 00000100:00100000:3.0:1788541053.318189:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945357824 00000100:00100000:3.0:1788541053.318247:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:3.0:1788541053.318256:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875420945357824:12345-192.168.202.59@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788541053.318511:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:3.0:1788541053.318548:0:6705:0:(genops.c:1385:class_connect()) connect: client 103c367e-0a85-454e-8289-79a7b521f7f2, cookie 0xc9a6a13d3cd1afdc 00002000:00100000:3.0:1788541053.318561:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 103c367e-0a85-454e-8289-79a7b521f7f2/ffff98d786464000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788541053.318597:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788541053.318925:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788541053.318962:0:6705:0:(import.c:65:import_set_state_nolock()) ffff98d786467000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541053.319194:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2357:x1875420945357824:12345-192.168.202.59@tcp:8:lhsmtool_posix.0 Request processed in 936us (8528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541053.319219:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1788541053.331518:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541053.331636:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945357952 00000100:00100000:1.0:1788541053.331646:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945357952 00000100:00100000:1.0:1788541053.331786:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:1.0:1788541053.331799:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:0:x1875420945357952:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788541053.332280:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541053.390315:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:0:x1875420945357952:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 58508us (58796us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788541053.390329:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000001:00080000:3.0:1788541053.391493:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788541053.391510:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000100:00100000:3.0:1788541053.393694:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.393896:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945358208 00000100:00100000:0.0:1788541053.393906:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945358208 00000100:00100000:0.0:1788541053.394043:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1788541053.394054:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:10441:x1875420945358208:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541053.394305:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:10441:x1875420945358208:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 251us (618us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788541053.394313:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:0.0:1788541053.398781:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.399382:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945358464 00000100:00100000:2.0:1788541053.399394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945358464 00000100:00100000:2.0:1788541053.399498:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:2.0:1788541053.399508:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:10441:x1875420945358464:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541053.399642:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:10441:x1875420945358464:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 135us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.399650:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:1.0:1788541053.403149:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968452864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541053.403223:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541053.403524:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.403655:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945358592 00000100:00100000:3.0:1788541053.403663:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945358592 00000100:00100000:3.0:1788541053.403720:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:3.0:1788541053.403730:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+56:10441:x1875420945358592:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541053.403748:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788541053.403854:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968452864 00000100:00100000:2.0:1788541053.403859:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968452864 00000100:00100000:2.0:1788541053.403897:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788541053.403906:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968452864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541053.403922:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541053.404045:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968452864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.404052:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788541053.404200:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968452864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541053.404258:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1afe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16b5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.404398:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1afea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.404641:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1afea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.404656:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1afea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541053.404691:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541053.404709:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1afea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.404734:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1afe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16b5 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.404992:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1afea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16b5 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.405000:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:3.0:1788541053.405003:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788541053.405007:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cda00, rc 0) 00000100:00100000:3.0:1788541053.405061:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+57:10441:x1875420945358592:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1333us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541053.405068:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:0.0:1788541053.409017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.409456:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945358720 00000100:00100000:2.0:1788541053.409466:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945358720 00000100:00100000:2.0:1788541053.409516:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1788541053.409525:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2359:x1875420945358720:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541053.409544:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541053.409565:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16bc expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541053.409687:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af87d, blocks: 0x1 00010000:00010000:2.0:1788541053.409709:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788541053.409714:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541053.409724:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.409745:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.409773:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603c00, rc 0) 00000100:00100000:2.0:1788541053.409831:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78904ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945358720:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 305us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.409839:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:0.0:1788541053.414072:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.414237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945358976 00000100:00100000:2.0:1788541053.414248:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945358976 00000100:00100000:2.0:1788541053.414317:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:2.0:1788541053.414329:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+57:10441:x1875420945358976:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541053.414464:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+57:10441:x1875420945358976:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 137us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.414473:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:0.0:1788541053.418501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.418608:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945359104 00000100:00100000:2.0:1788541053.418617:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945359104 00000100:00100000:2.0:1788541053.418668:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1788541053.418679:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:10441:x1875420945359104:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541053.418697:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541053.418715:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16c3 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.418748:0:9248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.418757:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541053.418772:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541053.418791:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.418827:0:9248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.418841:0:9248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541053.418857:0:9248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9248:1875420968452992:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541053.418948:0:9248:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb5190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541053.423315:0:9248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9248:1875420968452992:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541053.423355:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.423377:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:2.0:1788541053.423480:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:10441:x1875420945359104:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4801us (4987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.423489:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:0.0:1788541053.425520:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.425864:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945359232 00000100:00100000:2.0:1788541053.425874:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945359232 00010000:00010000:2.0:1788541053.425915:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541053.425955:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1788541053.425973:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945359232:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541053.426003:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541053.426029:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.426043:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.426065:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1aff1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16bc expref: 7 pid: 6704 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.426082:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541053.426087:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541053.426096:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.426117:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.426155:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541053.426169:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875420968453120:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541053.426562:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb5190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541053.432463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541053.432542:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945359360 00000100:00100000:1.0:1788541053.432551:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945359360 00002000:00100000:1.0:1788541053.432598:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98d7ada2c000 x1875420945359360/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:424/0 lens 504/0 e 0 to 0 dl 1788541064 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541053.432611:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7ada2c000 with x1875420945359360 ext(0->8) 00002000:00010000:1.0:1788541053.432617:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7ada2c000 00000100:00100000:1.0:1788541053.432650:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1788541053.432659:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945359360:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788541053.433399:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:2359:x1875420945359360:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 738us (942us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788541053.433436:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00002000:00100000:1.0:1788541053.433444:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff98d7ada2c000 x1875420945359360/t4294967302(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:424/0 lens 504/448 e 0 to 0 dl 1788541064 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541053.433459:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7ada2c000 with x1875420945359360 ext(0->8) 00002000:00010000:1.0:1788541053.433463:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7ada2c000 00000100:00100000:2.0:1788541053.434664:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875420968453120:192.168.202.59@tcp:105: 00010000:00010000:2.0:1788541053.434689:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541053.434750:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945359232:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 8786us (9237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.435799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:0.0:1788541053.439052:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.439163:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945359488 00000100:00100000:3.0:1788541053.439173:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945359488 00000100:00100000:3.0:1788541053.439239:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:3.0:1788541053.439250:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+57:10441:x1875420945359488:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788541053.486554:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788541053.486570:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788541053.486598:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788541053.486624:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788541053.486633:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d7831b63c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788541053.486637:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d7831b6e40 00000020:00080000:1.0:1788541053.486641:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7adc43400 00000100:00100000:1.0:1788541053.486910:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968453248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788541053.487048:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541053.487125:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968453248 00000100:00100000:1.0:1788541053.487133:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968453248 00000100:00100000:1.0:1788541053.487178:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541053.487188:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968453248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788541053.487216:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788541053.487250:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9af87a, atime: 0x6a9af87a, ctime: 0x6a9af87a, blocks: 0x1 00010000:00010000:1.0:1788541053.487258:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.487486:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788541053.487491:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541053.487498:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.487532:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.487542:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.487549:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.487576:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541053.488109:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541053.488117:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.488126:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541053.488130:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.488140:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.488157:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.488173:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1afff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.488195:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541053.488197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541053.488198:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541053.488831:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968453248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1642us (1781us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788541053.488838:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541053.488871:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968453376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541053.488893:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788541053.488938:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7bf51b480/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788541053.488942:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968453248:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788541053.489088:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+13:10441:x1875420945359488:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 49837us (50042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.489098:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00000020:00080000:0.0:1788541053.489137:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788541053.489220:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788541053.489277:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968453376 00000100:00100000:2.0:1788541053.489284:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968453376 00000100:00100000:2.0:1788541053.489318:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788541053.489323:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968453376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788541053.489446:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788541053.489449:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788541053 00002000:00010000:2.0:1788541053.489451:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788541053.489453:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788541053 -> 1788541053 00002000:00010000:2.0:1788541053.489454:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788541053.489481:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875420968453376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (587us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788541053.489485:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1788541053.489617:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7b2fd8a80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788541053.489621:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968453376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788541053.494554:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541053.494614:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945359616 00000100:00100000:1.0:1788541053.494625:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945359616 00000100:00100000:1.0:1788541053.494682:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:1.0:1788541053.494692:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945359616:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788541053.517235:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788541053.517261:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788541053.517383:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945359616:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 22687us (22834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541053.517404:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1788541053.519475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541053.519511:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945359872 00000100:00100000:0.0:1788541053.519521:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945359872 00000100:00100000:0.0:1788541053.519575:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:0.0:1788541053.519585:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:10441:x1875420945359872:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541053.519636:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541053.519659:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1afea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16b5 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.519676:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:0.0:1788541053.519680:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541053.519704:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.519715:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.519722:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541053.519941:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000637dd5d7 reply state 00000000cbacdf12 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.519948:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541053.520126:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:10441:x1875420945359872:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 537us (656us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788541053.520134:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00010000:00010000:3.0:1788541053.522040:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.522053:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.522059:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.522062:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541053.522066:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.522071:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.522083:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:3.0:1788541053.522085:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541053.522088:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.522122:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.522592:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.522666:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945360000 00000100:00100000:2.0:1788541053.522676:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945360000 00000100:00100000:2.0:1788541053.522850:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:2.0:1788541053.522864:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945360000:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788541053.523062:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788541053.523064:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788541053 -> 1788541051 00002000:00010000:2.0:1788541053.523066:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788541050 00002000:00010000:2.0:1788541053.523068:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788541053 -> 1788541051 00002000:00010000:2.0:1788541053.523069:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788541053.523128:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945360000:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 270us (539us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788541053.523142:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:0.0:1788541053.525098:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541053.525174:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945360256 00000100:00100000:1.0:1788541053.525182:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945360256 00000100:00100000:1.0:1788541053.525227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:1.0:1788541053.525237:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+13:10441:x1875420945360256:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788541053.525303:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.525320:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.525326:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.525354:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.525364:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 13 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.525374:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf51ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968453504:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541053.525485:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3fd80 going to sleep for 11 seconds 00010000:00010000:0.0:1788541053.527685:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541053.527880:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf51ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968453504:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541053.527906:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.529664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.529777:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945360384 00000100:00100000:3.0:1788541053.529785:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945360384 00010000:00010000:3.0:1788541053.529815:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541053.529850:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:3.0:1788541053.529859:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+14:2358:x1875420945360384:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541053.529872:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541053.529879:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.529892:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.529912:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1afc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16a7 expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.529928:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:3.0:1788541053.529931:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.529947:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.529953:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.529996:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541053.530057:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+13:2358:x1875420945360384:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 194us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541053.530064:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00010000:00010000:1.0:1788541053.530188:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530197:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530244:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530252:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530259:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530266:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541053.530271:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530279:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530289:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:1.0:1788541053.530292:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788541053.530296:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.530301:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b00d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.530344:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+12:10441:x1875420945360256:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 5109us (5254us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788541053.530353:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:0.0:1788541053.533746:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541053.533901:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945360512 00000100:00100000:1.0:1788541053.533914:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945360512 00000100:00100000:1.0:1788541053.533995:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1788541053.534020:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945360512:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788541053.534067:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.534086:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.534096:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541053.534109:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541053.534115:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.534152:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.534166:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 7 pid: 9248 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.534180:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf51a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968453632:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541053.534271:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541053.539542:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.539839:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945360640 00000100:00100000:3.0:1788541053.539850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945360640 00010000:00010000:3.0:1788541053.539893:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 8 pid: 9248 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541053.539927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:3.0:1788541053.539939:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945360640:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541053.539954:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788541053.540725:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf51a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968453632:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541053.540767:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.540928:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 8 pid: 9248 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.540942:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 8 pid: 9248 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.541039:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d04e5c6e/0xc9a6a13d3cd1aff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16c3 expref: 8 pid: 9248 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.541056:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541053.541060:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541053.541066:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.541076:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.541152:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541053.541216:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945360640:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1280us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.541225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00010000:00010000:1.0:1788541053.543050:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543083:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543145:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543154:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543164:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543171:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541053.543175:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543184:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543200:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.543208:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1b014 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.543520:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945360512:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 9496us (9779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541053.543531:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1788541053.547434:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.547682:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945360896 00000100:00100000:3.0:1788541053.547693:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945360896 00000100:00100000:3.0:1788541053.547746:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:3.0:1788541053.547756:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+12:10441:x1875420945360896:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788541053.547839:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.547858:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.547884:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.548485:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.548495:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.548501:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.548528:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.548539:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 13 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541053.548549:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fdad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968453760:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541053.548620:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7888ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1788541053.553287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.553354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945361024 00000100:00100000:2.0:1788541053.553364:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945361024 00010000:00010000:2.0:1788541053.553446:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541053.553509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:2.0:1788541053.553519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+14:2358:x1875420945361024:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541053.553535:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541053.553542:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.553555:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 14 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.553577:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:2.0:1788541053.553583:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.553593:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.553600:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.553621:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541053.553668:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+14:2358:x1875420945361024:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 150us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.553675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00010000:00010000:1.0:1788541053.555355:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1afd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ae expref: 13 pid: 5850 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.555373:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fdad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968453760:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541053.555392:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.555400:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.555404:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541053.555634:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788541053.555745:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788541053.555842:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788541053.555912:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf518380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875420968453888:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788541053.556045:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541053.556148:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968453888 00000100:00100000:2.0:1788541053.556155:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968453888 00000100:00100000:1.0:1788541053.556155:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78133a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788541053.556257:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541053.556276:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1875420968453888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788541053.556370:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1875420968453888:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.556379:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541053.556465:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788541053.556470:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7b2fd8a80, transno 4294967303 00000100:00100000:1.0:1788541053.556485:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf518380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875420968453888:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788541053.556864:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788541053.556913:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf518380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875420968454016:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788541053.556938:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541053.557653:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541053.557694:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968454016 00000100:00100000:3.0:1788541053.557700:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968454016 00000100:00100000:3.0:1788541053.557728:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541053.557734:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875420968454016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788541053.558160:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875420968454016:12345-0@lo:1000:mdt00_002.0 Request processed in 424us (1219us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788541053.558169:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541053.558466:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf518380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875420968454016:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788541053.558499:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558506:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558511:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558514:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cde00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.558518:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558523:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558534:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78b22bc00) 00010000:00010000:0.0:1788541053.558536:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541053.558540:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558544:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b022 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558571:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558583:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558587:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558589:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541053.558591:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558594:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558599:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:0.0:1788541053.558600:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541053.558603:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558606:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1af50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558621:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558631:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558637:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558659:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.558673:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 16 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.558682:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968454144:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541053.558773:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541053.560771:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968454144:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541053.560797:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541053.561845:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541053.561923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945361152 00000100:00100000:2.0:1788541053.561932:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945361152 00010000:00010000:2.0:1788541053.561969:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 17 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541053.562020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:2.0:1788541053.562030:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+17:2358:x1875420945361152:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541053.562046:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541053.562053:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 17 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.562066:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 17 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.562088:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1af6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1692 expref: 17 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.562115:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:2.0:1788541053.562120:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.562131:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.562138:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541053.562183:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541053.562249:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+16:2358:x1875420945361152:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 220us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541053.562256:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00010000:00010000:1.0:1788541053.562303:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562310:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562323:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562330:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562336:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562342:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541053.562346:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562354:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562365:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:1.0:1788541053.562373:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541053.562378:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562384:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b029 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562396:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562401:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562431:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562437:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541053.562440:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562446:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562455:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78b22be00) 00010000:00010000:1.0:1788541053.562457:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541053.562460:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541053.562465:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b01b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541053.562672:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+15:10441:x1875420945360896:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 14917us (15274us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788541053.562692:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000020:00080000:1.0:1788541053.562696:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788541053.562927:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541053.562932:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541053.562958:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788541053.562975:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541053.572351:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541053.572618:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945361408 00000100:00100000:3.0:1788541053.572630:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945361408 00000100:00100000:3.0:1788541053.572696:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:3.0:1788541053.572707:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+15:10441:x1875420945361408:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788541053.573392:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788541053.573543:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788541053.573593:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.573609:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.573621:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.573629:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.573635:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.573641:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541053.573654:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541053.573754:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+17:10441:x1875420945361408:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1414us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788541053.573763:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000020:00080000:3.0:1788541053.573768:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788541053.573996:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541053.574003:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.574011:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541053.574015:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.574023:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.574035:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff98d78320d000) 00010000:00010000:0.0:1788541053.574038:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788541053.574042:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.574047:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b030 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541053.574070:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541053.574071:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541053.574073:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541054.554310:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541054.876009:0:12066:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541054.876019:0:12066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541054.876056:0:12066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788541054.876062:0:12066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541055.041219:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.041569:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945361664 00000100:00100000:0.0:1788541055.041579:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945361664 00000100:00080000:2.0:1788541055.041656:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541055.046904:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:0.0:1788541055.046924:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+17:10458:x1875420945361664:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541055.046954:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.046977:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16ca expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.047079:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1b03e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.047114:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1b03e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.047130:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1b03e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541055.047142:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788541055.047401:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ca expref: 20 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.047461:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1b03e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ca expref: 19 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.047469:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541055.047472:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541055.047476:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7400, rc 0) 00000100:00100000:0.0:1788541055.047543:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+19:10458:x1875420945361664:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 628us (6335us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788541055.047551:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:1.0:1788541055.060974:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.061050:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945361792 00000100:00100000:3.0:1788541055.061061:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945361792 00000100:00100000:3.0:1788541055.061146:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:3.0:1788541055.061156:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:10458:x1875420945361792:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:3.0:1788541055.061242:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061470:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061485:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061502:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061509:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061516:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061842:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061852:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061860:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541055.061904:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061917:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061930:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061937:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061943:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541055.061948:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061955:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061967:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541055.061970:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541055.061975:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061981:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b04c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.061993:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062000:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062005:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062010:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541055.062018:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062024:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062032:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78320d500) 00010000:00010000:3.0:1788541055.062034:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541055.062038:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062043:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062058:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062064:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062070:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062075:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541055.062078:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.062083:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.065573:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320d400) 00010000:00010000:3.0:1788541055.065582:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541055.065677:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.065689:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.065800:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:10458:x1875420945361792:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 4641us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541055.065809:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:3.0:1788541055.117567:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541055.117753:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945362048 00000100:00100000:1.0:1788541055.117764:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945362048 00000100:00100000:1.0:1788541055.117884:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:1.0:1788541055.117895:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+19:10461:x1875420945362048:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1788541055.117916:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541055.117939:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16d1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118021:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118036:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118048:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118063:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118069:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118076:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118360:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118375:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118383:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541055.118392:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788541055.118526:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118534:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118541:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118547:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541055.118552:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118559:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118572:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541055.118576:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541055.118581:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118587:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118600:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118612:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118618:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118623:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541055.118627:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118632:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118640:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d785548e00) 00010000:00010000:1.0:1788541055.118643:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541055.118645:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118651:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b06f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118697:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118710:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.118717:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:1.0:1788541055.118719:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541055.118727:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030000, rc 0) 00000100:00100000:1.0:1788541055.118814:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+21:10461:x1875420945362048:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 920us (1257us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788541055.118822:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:1.0:1788541055.126557:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.126725:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945362176 00000100:00100000:0.0:1788541055.126736:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945362176 00000100:00100000:0.0:1788541055.126843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1788541055.126855:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+21:10461:x1875420945362176:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1788541055.126921:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.126940:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.126954:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127032:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127040:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127066:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127072:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.127077:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127096:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127110:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:0.0:1788541055.127114:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541055.127119:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.127126:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541055.127245:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+21:10461:x1875420945362176:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 392us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541055.127263:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:2.0:1788541055.131699:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541055.131774:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945362432 00000100:00100000:1.0:1788541055.131784:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945362432 00000100:00100000:1.0:1788541055.131845:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1788541055.131855:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+21:10461:x1875420945362432:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1788541055.132114:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+22:10461:x1875420945362432:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 259us (423us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788541055.132122:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1788541055.196175:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.196220:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945362688 00000100:00100000:0.0:1788541055.196232:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945362688 00000100:00100000:0.0:1788541055.196554:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:0.0:1788541055.196567:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+22:9982:x1875420945362688:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541055.196750:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.196774:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b08b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16d8 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.196916:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.196931:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.196940:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.196976:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.196990:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 23 pid: 5850 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541055.197003:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968454272:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541055.197117:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541055.198943:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968454272:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541055.199138:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541055.215168:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541055.215677:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945362816 00000100:00100000:2.0:1788541055.215688:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945362816 00010000:00010000:2.0:1788541055.215736:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 24 pid: 5850 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541055.215835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1788541055.215846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+24:2358:x1875420945362816:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541055.215862:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541055.215879:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 24 pid: 5850 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.215894:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 24 pid: 5850 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.215920:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d1 expref: 24 pid: 5850 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.215961:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:2.0:1788541055.215966:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.215975:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.215983:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.216018:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541055.216095:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+23:2358:x1875420945362816:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 242us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541055.216102:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00010000:00010000:0.0:1788541055.219532:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.219552:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541055.219578:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788541055.219797:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b08b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 24 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.219825:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 23 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.219853:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:0.0:1788541055.219856:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541055.219861:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7200, rc 0) 00000100:00100000:0.0:1788541055.219975:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+23:9982:x1875420945362688:12345-192.168.202.59@tcp:101:bash.0 Request processed in 23409us (23806us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788541055.219984:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:1.0:1788541055.228689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.228974:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363072 00000100:00100000:3.0:1788541055.228987:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363072 00000100:00100000:3.0:1788541055.229116:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 89 00000100:00100000:3.0:1788541055.229128:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:9982:x1875420945363072:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:3.0:1788541055.229691:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.229711:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.229725:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541055.229916:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788541055.229943:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000260619fa reply state 00000000de7b9a0b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.229953:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788541055.230012:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788541055.230133:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+27:9982:x1875420945363072:12345-192.168.202.59@tcp:36:bash.0 Request processed in 1005us (1451us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788541055.230157:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 89 00000020:00080000:3.0:1788541055.230162:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788541055.235152:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1788541055.235630:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.235644:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.235652:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.235659:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541055.235664:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.235673:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.235713:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:2.0:1788541055.235716:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541055.235723:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.235730:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b0a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.235963:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363200 00000100:00100000:3.0:1788541055.236041:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363200 00000100:00100000:3.0:1788541055.236160:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:3.0:1788541055.236172:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+26:9982:x1875420945363200:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541055.236200:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541055.236218:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b0a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16df expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.236300:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16df expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.236314:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b0a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16df expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.236333:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:3.0:1788541055.236336:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541055.236339:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd200, rc 0) 00000100:00100000:3.0:1788541055.236442:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+27:9982:x1875420945363200:12345-192.168.202.59@tcp:101:bash.0 Request processed in 239us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541055.236451:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:1.0:1788541055.247618:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.247859:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363328 00000100:00100000:0.0:1788541055.247940:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363328 00000100:00100000:0.0:1788541055.248054:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:0.0:1788541055.248063:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:9982:x1875420945363328:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541055.248079:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.248110:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16e6 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541055.248141:0:9248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9af87b, atime: 0x6a9af87a, ctime: 0x6a9af87b, blocks: 0xb 00010000:00010000:0.0:1788541055.248161:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1788541055.248167:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541055.248175:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.248195:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.248209:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7800, rc 0) 00000100:00100000:0.0:1788541055.248460:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:9982:x1875420945363328:12345-192.168.202.59@tcp:101:bash.0 Request processed in 397us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541055.248469:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00080000:2.0:1788541055.250017:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541055.251369:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.251467:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363456 00000100:00100000:3.0:1788541055.251476:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363456 00002000:00010000:3.0:1788541055.251514:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788541055.251518:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7ada11180 with x1875420945363456 ext(0->18446744073709551615) 00002000:00010000:3.0:1788541055.251531:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7ada11180. 00000100:00100000:3.0:1788541055.251559:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:3.0:1788541055.251568:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2361:x1875420945363456:12345-192.168.202.59@tcp:10:bash.0 00002000:00010000:3.0:1788541055.252019:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788541055.252024:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788541051 -> 1788541055 00002000:00010000:3.0:1788541055.252027:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788541050 -> 1788541050 00002000:00010000:3.0:1788541055.252029:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788541051 -> 1788541055 00002000:00010000:3.0:1788541055.252031:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788541055.252096:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2361:x1875420945363456:12345-192.168.202.59@tcp:10:bash.0 Request processed in 519us (724us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788541055.252104:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00002000:00010000:3.0:1788541055.252107:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788541055.252110:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7ada11180 with x1875420945363456 ext(0->18446744073709551615) 00002000:00010000:3.0:1788541055.252114:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7ada11180. 00000100:00100000:1.0:1788541055.323222:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.323450:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363584 00000100:00100000:0.0:1788541055.323463:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363584 00000100:00100000:0.0:1788541055.323532:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:0.0:1788541055.323542:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+27:10475:x1875420945363584:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1788541055.323624:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323643:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323656:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323672:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323681:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323687:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323919:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323929:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323936:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541055.323983:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.323995:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324002:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324009:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324015:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.324019:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324028:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324039:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541055.324042:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.324047:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324053:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324065:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324072:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324093:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324099:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.324103:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324110:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324117:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78b22b200) 00010000:00010000:0.0:1788541055.324119:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.324122:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324128:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324143:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324149:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324155:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324160:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.324162:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324177:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324183:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:0.0:1788541055.324185:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.324188:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.324193:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541055.324568:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+27:10475:x1875420945363584:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1025us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541055.324577:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:1.0:1788541055.371686:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.371770:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363840 00000100:00100000:0.0:1788541055.371781:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363840 00000100:00100000:0.0:1788541055.371840:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:0.0:1788541055.371850:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+27:10478:x1875420945363840:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541055.371879:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.371899:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16ed expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.371970:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.371985:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.371997:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372028:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372037:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372044:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372336:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b0df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372347:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372354:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541055.372363:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788541055.372478:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372485:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372491:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372497:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.372501:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372517:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372528:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541055.372531:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.372535:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372540:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b0d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372551:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372557:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372563:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372567:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.372569:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372575:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372580:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78b22b200) 00010000:00010000:0.0:1788541055.372582:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.372585:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372599:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372638:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ed expref: 30 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372651:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ed expref: 29 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.372658:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:0.0:1788541055.372660:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788541055.372663:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7e00, rc 0) 00000100:00100000:0.0:1788541055.372729:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+29:10478:x1875420945363840:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 880us (1053us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788541055.372736:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:1.0:1788541055.376596:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.376675:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945363968 00000100:00100000:0.0:1788541055.376684:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945363968 00000100:00100000:0.0:1788541055.376745:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:0.0:1788541055.376755:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+29:10478:x1875420945363968:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:0.0:1788541055.376817:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.376831:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 29 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.376839:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.376899:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 29 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.376912:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 29 pid: 9724 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541055.376926:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968454400:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541055.377024:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541055.381099:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.381207:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968454400:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541055.381258:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.381646:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945364224 00000100:00100000:3.0:1788541055.381653:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945364224 00000100:00100000:3.0:1788541055.381710:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1788541055.381721:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+30:5597:x1875420945364224:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788541055.382053:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+31:5597:x1875420945364224:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 333us (973us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788541055.382061:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1788541055.385510:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541055.385614:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945364352 00000100:00100000:2.0:1788541055.385624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945364352 00010000:00010000:2.0:1788541055.385665:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 31 pid: 9724 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541055.385708:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1788541055.385719:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+31:2358:x1875420945364352:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541055.385735:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541055.385754:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 31 pid: 9724 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.385768:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 31 pid: 9724 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.385788:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b092 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16d8 expref: 31 pid: 9724 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.385804:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:2.0:1788541055.385821:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.385831:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.385839:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.386009:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541055.386069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+30:2358:x1875420945364352:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 351us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541055.386078:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00010000:00010000:1.0:1788541055.386157:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386165:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386207:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386215:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386222:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386242:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541055.386254:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386263:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386273:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:1.0:1788541055.386276:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541055.386280:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.386286:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b0ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541055.386328:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+29:10478:x1875420945363968:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 9574us (9741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541055.386336:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:2.0:1788541055.390285:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.390368:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945364608 00000100:00100000:3.0:1788541055.390378:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945364608 00000100:00100000:3.0:1788541055.390472:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1788541055.390483:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+29:10478:x1875420945364608:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541055.390729:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+30:10478:x1875420945364608:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 246us (451us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788541055.390762:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1788541055.488282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.488392:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945364864 00000100:00100000:0.0:1788541055.488403:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945364864 00000100:00100000:0.0:1788541055.488502:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:0.0:1788541055.488514:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+30:10489:x1875420945364864:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:0.0:1788541055.488537:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.488559:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16f4 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.488653:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.488668:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.488679:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.488702:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.488709:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.488715:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489405:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489441:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489449:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541055.489459:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788541055.489548:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489556:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489562:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489568:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.489573:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489590:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489602:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541055.489606:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.489611:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489617:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b0fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489630:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489634:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489640:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489645:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541055.489647:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489652:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489659:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78b22b200) 00010000:00010000:0.0:1788541055.489661:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541055.489664:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489680:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489725:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b0f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16f4 expref: 33 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489816:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16f4 expref: 32 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.489826:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:0.0:1788541055.489828:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541055.489830:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6c00, rc 0) 00000100:00100000:0.0:1788541055.489900:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+32:10489:x1875420945364864:12345-192.168.202.59@tcp:101:cat.0 Request processed in 1389us (1629us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788541055.489908:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:2.0:1788541055.494479:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.494571:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945365120 00000100:00100000:3.0:1788541055.494582:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945365120 00000100:00100000:3.0:1788541055.494642:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:3.0:1788541055.494653:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:10489:x1875420945365120:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:3.0:1788541055.494910:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+33:10489:x1875420945365120:12345-192.168.202.59@tcp:35:cat.0 Request processed in 258us (439us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788541055.494918:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1788541055.519327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.519475:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945365376 00000100:00100000:3.0:1788541055.519484:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945365376 00000100:00100000:3.0:1788541055.519542:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:3.0:1788541055.519551:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+33:10490:x1875420945365376:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:3.0:1788541055.519603:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788541055.519628:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16f4 expref: 33 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519648:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b0df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ed expref: 32 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519659:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b0a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16df expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519668:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d785548800) 00010000:00010000:3.0:1788541055.519678:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541055.519709:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519722:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519731:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519758:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519765:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.519771:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520004:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520012:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520018:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541055.520878:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788541055.520889:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340520479655ns, next at 341520476520ns, rc = 0 00010000:00010000:3.0:1788541055.520950:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520962:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520977:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520985:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520991:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.520997:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521026:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541055.521048:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521055:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521062:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521067:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541055.521071:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521078:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521099:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541055.521102:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788541055.521113:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521119:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b125 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521136:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521141:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521147:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521152:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541055.521154:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521160:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521167:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541055.521169:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541055.521172:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.521177:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b117 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541055.521192:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000545961f7 reply state 0000000088862abf transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.521211:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788541055.521426:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541055.521433:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.521450:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541055.521453:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.521459:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.521468:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff98d78320d500) 00010000:00010000:1.0:1788541055.521471:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788541055.521474:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.521479:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b12c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.521492:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541055.521494:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541055.521496:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541055.522022:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:10490:x1875420945365376:12345-192.168.202.59@tcp:36:rm.0 Request processed in 2466us (2700us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788541055.522032:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00010000:00010000:3.0:1788541055.535758:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.535778:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.535785:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.535792:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541055.535797:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.535805:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.535823:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78320d400) 00010000:00010000:3.0:1788541055.535826:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541055.535831:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.535837:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b11e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.576947:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541055.583765:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.583857:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945365632 00000100:00100000:3.0:1788541055.583869:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945365632 00000100:00100000:3.0:1788541055.583947:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:3.0:1788541055.583958:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+31:10496:x1875420945365632:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541055.583993:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541055.584016:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b133 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac16fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.584160:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.584176:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.584188:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.584203:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.584211:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.584216:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541055.584954:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788541055.585128:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585139:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585148:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585178:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585185:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585198:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585204:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541055.585209:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585216:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585229:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:2.0:1788541055.585232:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541055.585236:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585243:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b13a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541055.585255:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a21f6ed reply state 00000000f31a830d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541055.585262:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788541055.585290:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b133 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585303:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.585311:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:2.0:1788541055.585314:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541055.585320:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603600, rc 0) 00000100:00100000:2.0:1788541055.585397:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+34:10496:x1875420945365632:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1440us (1642us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788541055.585448:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:0.0:1788541055.589873:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541055.589965:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945365760 00000100:00100000:1.0:1788541055.589984:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945365760 00000100:00100000:1.0:1788541055.590066:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:1.0:1788541055.590077:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945365760:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1788541055.590105:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541055.590127:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1702 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541055.590154:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541055.590175:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788541055.590179:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541055.590202:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.590223:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.590236:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:1.0:1788541055.590296:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945365760:12345-192.168.202.59@tcp:101:bash.0 Request processed in 221us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541055.590303:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00010000:00010000:2.0:1788541055.590579:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.590588:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.590595:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.590601:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541055.590607:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.590616:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.590629:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d78320d400) 00010000:00010000:2.0:1788541055.590632:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541055.590637:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541055.590643:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b141 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788541055.591405:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541055.596275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.596367:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945365888 00000100:00100000:0.0:1788541055.596378:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945365888 00000100:00100000:0.0:1788541055.596458:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:0.0:1788541055.596469:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:10496:x1875420945365888:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541055.596487:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.596510:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1709 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.596540:0:9248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.596564:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541055.596569:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541055.596576:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 9 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.596613:0:9248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.596627:0:9248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541055.596642:0:9248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968454528:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541055.596745:0:9248:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541055.599364:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.599480:0:9248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968454528:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541055.599518:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 9 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.599540:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6a00, rc 0) 00000100:00100000:0.0:1788541055.599603:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:10496:x1875420945365888:12345-192.168.202.59@tcp:101:bash.0 Request processed in 3136us (3338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541055.599612:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1788541055.600217:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945366016 00000100:00100000:3.0:1788541055.600224:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945366016 00010000:00010000:3.0:1788541055.600259:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.600293:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1788541055.600315:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945366016:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541055.600329:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541055.600351:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.600363:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.600384:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1b156 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1702 expref: 9 pid: 6704 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.600399:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541055.600403:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541055.600448:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 8 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.600460:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 8 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.600495:0:6720:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 8 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.600510:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fdb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6720:1875420968454656:192.168.202.59@tcp:105: 00000100:00100000:3.0:1788541055.600565:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d799b7bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541055.611737:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fdb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6720:1875420968454656:192.168.202.59@tcp:105: 00010000:00010000:3.0:1788541055.611789:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541055.611862:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945366016:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 11546us (12507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541055.611874:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1788541055.624842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.624882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.624920:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541055.625047:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945366400 00000100:00100000:2.0:1788541055.625057:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945366400 00002000:00100000:2.0:1788541055.625123:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98d7ada2ea00 x1875420945366400/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:426/0 lens 504/0 e 0 to 0 dl 1788541066 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541055.625134:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7ada2ea00 with x1875420945366400 ext(0->8) 00002000:00010000:2.0:1788541055.625140:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98d7ada2ea00 00000100:00100000:2.0:1788541055.625176:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1788541055.625186:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945366400:12345-192.168.202.59@tcp:4:bash.0 00000100:00100000:2.0:1788541055.625730:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+10:2358:x1875420945366400:12345-192.168.202.59@tcp:4:bash.0 Request processed in 542us (805us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788541055.625739:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00002000:00100000:2.0:1788541055.625746:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff98d7ada2ea00 x1875420945366400/t4294967302(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:426/0 lens 504/448 e 0 to 0 dl 1788541066 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541055.625756:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7ada2ea00 with x1875420945366400 ext(0->8) 00002000:00010000:2.0:1788541055.625760:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98d7ada2ea00 00000100:00100000:3.0:1788541055.626226:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945366272 00000100:00100000:3.0:1788541055.626233:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945366272 00000100:00100000:3.0:1788541055.626293:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1788541055.626302:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+33:10496:x1875420945366272:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:3.0:1788541055.626590:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+34:10496:x1875420945366272:12345-192.168.202.59@tcp:35:bash.0 Request processed in 289us (1759us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788541055.626598:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:1.0:1788541055.626894:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945366528 00000100:00100000:1.0:1788541055.626900:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945366528 00000100:00100000:1.0:1788541055.626943:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:1.0:1788541055.626951:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:2358:x1875420945366528:12345-192.168.202.59@tcp:16:kworker.0 00000001:00080000:3.0:1788541055.676875:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1788541055.676896:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1788541055.676905:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788541055.677474:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945366528:12345-192.168.202.59@tcp:16:kworker.0 Request processed in 50517us (52584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541055.677487:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:2.0:1788541055.936403:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541055.936538:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945366656 00000100:00100000:1.0:1788541055.936550:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945366656 00000100:00100000:1.0:1788541055.936620:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:1.0:1788541055.936633:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+34:10512:x1875420945366656:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1788541055.936658:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541055.936680:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1710 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.936760:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b16b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.936777:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.936804:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541055.936842:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788541055.936846:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541055.936864:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b16b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.936891:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1710 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.936912:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b16b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1710 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.936923:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541055.936926:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541055.936930:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031c00, rc 0) 00000100:00100000:1.0:1788541055.937002:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:10512:x1875420945366656:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 371us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541055.937009:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:3.0:1788541055.940903:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.941331:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945366912 00000100:00100000:0.0:1788541055.941405:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945366912 00000100:00100000:0.0:1788541055.941655:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:0.0:1788541055.941666:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+35:10512:x1875420945366912:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541055.941692:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541055.941721:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b172 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1717 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.941957:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.941975:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.941988:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541055.942000:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788541055.942216:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b172 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1717 expref: 38 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.942235:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1717 expref: 37 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.942645:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:0.0:1788541055.942650:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541055.942668:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7200, rc 0) 00000100:00100000:0.0:1788541055.942860:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+37:10512:x1875420945366912:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1193us (1965us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788541055.942870:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:2.0:1788541055.957639:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541055.957786:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541055.960040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945367296 00000100:00100000:0.0:1788541055.960057:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945367296 00000100:00100000:0.0:1788541055.960173:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:0.0:1788541055.960185:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+37:2358:x1875420945367296:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541055.960202:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541055.960228:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1717 expref: 37 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541055.960249:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:0.0:1788541055.960255:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541055.960329:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+36:2358:x1875420945367296:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 146us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541055.960346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1788541055.963909:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945367168 00000100:00100000:1.0:1788541055.963927:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945367168 00000100:00100000:1.0:1788541055.964091:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:1.0:1788541055.964104:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+36:10512:x1875420945367168:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1788541055.964129:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541055.964151:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b187 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac171e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.964285:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b18e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.964302:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.964314:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541055.964328:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788541055.964498:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b187 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac171e expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.964520:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac171e expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.964530:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:1.0:1788541055.964534:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788541055.964537:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031000, rc 0) 00000100:00100000:1.0:1788541055.964611:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+38:10512:x1875420945367168:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 511us (6986us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788541055.964620:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:2.0:1788541055.979204:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541055.979357:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945367424 00000100:00100000:1.0:1788541055.979368:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945367424 00000100:00100000:1.0:1788541055.979458:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1788541055.979470:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945367424:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:1.0:1788541055.979517:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.979554:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.979564:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541055.979569:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541055.979573:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.979616:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.979632:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 6 pid: 9248 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541055.979648:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875420968454784:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541055.979804:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541055.990109:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875420968454784:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541055.990141:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541055.995815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541055.998092:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945367552 00000100:00100000:3.0:1788541055.998107:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945367552 00010000:00010000:3.0:1788541055.998157:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 7 pid: 9248 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541055.998210:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1788541055.998221:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945367552:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541055.998237:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788541055.998269:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788541055.998272:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788541055 00002000:00010000:3.0:1788541055.998275:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788541055 00002000:00010000:3.0:1788541055.998291:0:5837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788541055.998298:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 7 pid: 9248 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.998313:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 7 pid: 9248 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.998336:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b15d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1709 expref: 7 pid: 9248 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.998353:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541055.998358:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541055.998364:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.998376:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541055.998464:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541055.998526:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945367552:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 305us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541055.998534:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00010000:00010000:1.0:1788541055.999337:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999352:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999393:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999403:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999441:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999449:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541055.999453:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999463:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999478:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541055.999485:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1b19c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541055.999558:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2359:x1875420945367424:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 20089us (20366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541055.999567:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:2.0:1788541056.002776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.002909:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945367808 00000100:00100000:3.0:1788541056.002921:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945367808 00000100:00100000:3.0:1788541056.002977:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:3.0:1788541056.002987:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+38:10512:x1875420945367808:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:3.0:1788541056.003066:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac171e expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541056.003377:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788541056.003450:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788541056.003722:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788541056.005048:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.005072:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.005091:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.005132:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.005150:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 42 pid: 5850 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541056.005164:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1875420968454912:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541056.005266:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541056.011976:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.012147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945367936 00000100:00100000:0.0:1788541056.012157:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945367936 00010000:00010000:0.0:1788541056.012198:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 43 pid: 5850 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.012253:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1788541056.012264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+43:2359:x1875420945367936:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541056.012279:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541056.012286:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 43 pid: 5850 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.012318:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 43 pid: 5850 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.012341:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:0.0:1788541056.012346:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.012356:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.012364:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.012383:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541056.012534:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16fb expref: 43 pid: 5850 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541056.012553:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1875420968454912:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541056.012574:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.012586:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.012592:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541056.012742:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788541056.012946:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788541056.013094:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968455040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788541056.013146:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541056.013171:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541056.013860:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968455040 00000100:00100000:3.0:1788541056.013868:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968455040 00000100:00080000:1.0:1788541056.013968:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541056.014598:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+44:2359:x1875420945367936:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1983us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.014611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1788541056.020716:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541056.020756:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1875420968455040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788541056.020898:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1875420968455040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (7751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.020906:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541056.021059:0:5854:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788541056.021066:0:5854:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788541056.021100:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7bf51b480, transno 4294967301 00000100:00100000:1.0:1788541056.021125:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968455040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788541056.021656:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788541056.021737:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968455168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788541056.021793:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541056.021820:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541056.021842:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968455168 00000100:00100000:1.0:1788541056.021849:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968455168 00000100:00100000:1.0:1788541056.021882:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541056.021889:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1875420968455168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788541056.022110:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1875420968455168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 220us (315us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788541056.022117:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541056.022156:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968455168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788541056.022204:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788541056.022240:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.022261:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.022269:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.022274:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541056.022278:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.022287:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.022302:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:1.0:1788541056.022305:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788541056.022310:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.022317:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541056.022543:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788541056.022633:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788541056.022645:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341022235811ns, next at 342022233428ns, rc = 0 00000001:00080000:1.0:1788541056.022653:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788541056.022686:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553c00) 00010000:00010000:1.0:1788541056.022689:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788541056.022697:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b18e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac171e expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541056.034141:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+45:10512:x1875420945367808:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 31141us (31361us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788541056.034156:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000020:00080000:1.0:1788541056.034164:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788541056.039321:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.039479:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945368064 00000100:00100000:2.0:1788541056.039489:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945368064 00000100:00100000:2.0:1788541056.039542:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:2.0:1788541056.039552:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+45:10512:x1875420945368064:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541056.039573:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541056.039598:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b1aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.039676:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1725 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.039692:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1725 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.039711:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.039714:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541056.039718:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541056.039791:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+46:10512:x1875420945368064:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 241us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.039798:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:3.0:1788541056.045773:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.045923:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945368320 00000100:00100000:2.0:1788541056.045933:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945368320 00000100:00100000:2.0:1788541056.045992:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:2.0:1788541056.046003:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+46:10512:x1875420945368320:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541056.046457:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+47:10512:x1875420945368320:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 454us (694us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788541056.046466:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:3.0:1788541056.124716:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.124778:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.124937:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945368576 00000100:00100000:1.0:1788541056.124948:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945368576 00000100:00100000:1.0:1788541056.125029:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00100000:1.0:1788541056.125040:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945368576:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541056.125130:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945368576:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.125138:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00080000:2.0:1788541056.126015:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541056.126629:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945368448 00000100:00100000:0.0:1788541056.126639:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945368448 00000100:00100000:0.0:1788541056.126705:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 289 00000100:00100000:0.0:1788541056.126715:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945368448:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541056.126790:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945368448:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 76us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.126798:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 289 00000100:00100000:3.0:1788541056.177472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.177667:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945368704 00000100:00100000:2.0:1788541056.177676:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945368704 00000100:00100000:2.0:1788541056.177744:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:2.0:1788541056.177754:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+47:10522:x1875420945368704:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:2.0:1788541056.177830:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177857:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177869:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177885:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177891:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177897:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177982:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177989:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.177996:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541056.178033:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178045:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178051:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178067:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178073:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541056.178090:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178098:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178109:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:2.0:1788541056.178112:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541056.178117:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178124:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b1b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178137:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178142:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178148:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178153:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541056.178156:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178170:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178177:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d786553400) 00010000:00010000:2.0:1788541056.178179:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541056.178182:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178187:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178200:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178207:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178212:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178217:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541056.178219:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178225:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178231:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.178332:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541056.178336:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.178351:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b1bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.178519:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+47:10522:x1875420945368704:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 764us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.178527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:2.0:1788541056.221631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.221741:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945368960 00000100:00100000:1.0:1788541056.221752:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945368960 00000100:00100000:1.0:1788541056.221816:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:1.0:1788541056.221828:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+47:10525:x1875420945368960:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1788541056.221853:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.221875:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b1c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac172c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.221950:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.221966:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.221977:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222007:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222015:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222022:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222154:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222164:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222172:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541056.222182:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788541056.222446:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222455:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222462:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222468:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541056.222472:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222490:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222503:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541056.222506:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541056.222511:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222518:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b1cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222533:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222539:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222546:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222552:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541056.222555:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222561:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222568:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d785548e00) 00010000:00010000:1.0:1788541056.222571:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541056.222574:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222590:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b1d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222638:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b1c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222655:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.222664:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541056.222667:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541056.222670:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:1.0:1788541056.222846:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+49:10525:x1875420945368960:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1018us (1224us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788541056.222854:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 102 00000100:00100000:1.0:1788541056.226983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.227105:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945369088 00000100:00100000:2.0:1788541056.227117:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945369088 00000100:00100000:2.0:1788541056.227225:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:2.0:1788541056.227237:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+49:10525:x1875420945369088:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1788541056.227328:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227347:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227360:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227390:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227398:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227435:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227444:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541056.227461:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227471:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227484:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.227487:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541056.227492:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.227498:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b1e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.227584:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+49:10525:x1875420945369088:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 348us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.227593:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:3.0:1788541056.229721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.229837:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945369344 00000100:00100000:1.0:1788541056.229848:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945369344 00000100:00100000:1.0:1788541056.229897:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:1.0:1788541056.229908:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+49:10525:x1875420945369344:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1788541056.230153:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+50:10525:x1875420945369344:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 246us (440us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788541056.230161:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:3.0:1788541056.298263:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.298444:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945369600 00000100:00100000:1.0:1788541056.298455:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945369600 00000100:00100000:1.0:1788541056.298519:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 104 00000100:00100000:1.0:1788541056.298545:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+50:10535:x1875420945369600:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1788541056.298570:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.298573:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788541056.298598:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b16b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1710 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.298620:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541056.298625:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541056.298638:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b1f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1733 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.298753:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.298767:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.298777:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.298812:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.298827:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 50 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541056.298841:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875420968455296:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541056.298948:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541056.319105:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.319205:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945369728 00000100:00100000:2.0:1788541056.319215:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945369728 00010000:00010000:2.0:1788541056.319275:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 51 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.319320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:2.0:1788541056.319331:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+51:2359:x1875420945369728:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541056.319349:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541056.319355:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 51 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.319369:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 51 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.319457:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.319463:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.319474:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.319483:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.319507:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541056.319562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+51:2359:x1875420945369728:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 232us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.319570:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00010000:00010000:3.0:1788541056.319865:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b1db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac172c expref: 50 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541056.319888:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875420968455296:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541056.319912:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.319921:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.319938:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541056.319959:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788541056.320147:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b1f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.320162:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.320171:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541056.320174:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541056.320177:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bde00, rc 0) 00000100:00100000:3.0:1788541056.320211:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+50:10535:x1875420945369600:12345-192.168.202.59@tcp:101:bash.0 Request processed in 21669us (21958us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788541056.320221:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 104 00000100:00100000:0.0:1788541056.325105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.325292:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945369984 00000100:00100000:2.0:1788541056.325304:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945369984 00000100:00100000:2.0:1788541056.325370:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 105 00000100:00100000:2.0:1788541056.325382:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+50:10535:x1875420945369984:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1788541056.325728:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.325754:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.325768:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541056.325824:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788541056.325849:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9de3067 reply state 000000006e3f638f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.325869:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541056.325974:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+53:10535:x1875420945369984:12345-192.168.202.59@tcp:36:bash.0 Request processed in 593us (880us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788541056.325982:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 105 00000020:00080000:2.0:1788541056.325987:0:9724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541056.328272:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.328290:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.328299:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.328306:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541056.328311:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.328339:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.328359:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541056.328363:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541056.328369:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.328376:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b205 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.332601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.332710:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945370112 00000100:00100000:3.0:1788541056.332849:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945370112 00000100:00100000:3.0:1788541056.332969:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00100000:3.0:1788541056.332981:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+52:10535:x1875420945370112:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541056.333006:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541056.333042:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b20c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac173a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.333176:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.333193:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.333203:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.333257:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.333279:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 53 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541056.333294:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968455424:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541056.333387:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788541056.339553:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.339669:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fdbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968455424:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541056.339699:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.339847:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945370240 00000100:00100000:2.0:1788541056.339855:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945370240 00010000:00010000:2.0:1788541056.339892:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 54 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.339933:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:2.0:1788541056.339942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+54:2358:x1875420945370240:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541056.339958:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541056.339966:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 54 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.339979:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 54 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.340005:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b1f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1733 expref: 54 pid: 5851 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.340035:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.340041:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.340052:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.340086:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.340115:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541056.340176:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+53:2358:x1875420945370240:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 234us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.340183:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00010000:00010000:3.0:1788541056.340447:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.340456:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541056.340499:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788541056.340503:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541056.340524:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.340554:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b20c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.340571:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.340579:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541056.340589:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541056.340592:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd600, rc 0) 00000100:00100000:3.0:1788541056.340620:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+52:10535:x1875420945370112:12345-192.168.202.59@tcp:101:bash.0 Request processed in 7642us (8033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.340628:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 106 00000100:00100000:0.0:1788541056.344631:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.344876:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945370496 00000100:00100000:1.0:1788541056.344887:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945370496 00000100:00100000:1.0:1788541056.344948:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:1.0:1788541056.344959:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:10535:x1875420945370496:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:1.0:1788541056.345271:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+53:10535:x1875420945370496:12345-192.168.202.59@tcp:35:bash.0 Request processed in 313us (650us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788541056.345279:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:1.0:1788541056.410615:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.410721:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945370624 00000100:00100000:0.0:1788541056.410743:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945370624 00000100:00100000:0.0:1788541056.410804:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:0.0:1788541056.410816:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+53:10541:x1875420945370624:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541056.410839:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541056.410859:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b21a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1741 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.410925:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.410940:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.410953:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541056.410989:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788541056.410993:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541056.411012:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.411038:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b21a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1741 expref: 55 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.411057:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1741 expref: 54 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.411066:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541056.411070:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541056.411103:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7600, rc 0) 00000100:00100000:0.0:1788541056.411168:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945370624:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 355us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.411175:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 107 00000100:00100000:2.0:1788541056.414909:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.415004:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945370752 00000100:00100000:1.0:1788541056.415015:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945370752 00000100:00100000:1.0:1788541056.415090:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:1.0:1788541056.415103:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945370752:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1788541056.415122:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.415143:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bc200/0xc9a6a13d3cd1b228 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1748 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415207:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415223:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415248:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415265:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415292:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415300:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415392:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415402:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415455:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541056.415492:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788541056.415496:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541056.415516:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415528:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415536:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415543:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415551:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415567:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541056.415572:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415581:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415594:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541056.415598:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541056.415603:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415611:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bdc00/0xc9a6a13d3cd1b22f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415626:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415633:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415640:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415646:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bde00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541056.415649:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415656:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415674:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d785548e00) 00010000:00010000:1.0:1788541056.415677:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541056.415681:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415687:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bde00/0xc9a6a13d3cd1b236 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415720:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bc200/0xc9a6a13d3cd1b228 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1748 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415735:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1748 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.415742:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541056.415745:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541056.415747:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd000, rc 0) 00000100:00100000:1.0:1788541056.415804:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:10541:x1875420945370752:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 703us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.415812:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 108 00000100:00100000:3.0:1788541056.418867:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.418969:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945370880 00000100:00100000:2.0:1788541056.418978:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945370880 00000100:00100000:2.0:1788541056.419043:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1788541056.419055:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+55:2361:x1875420945370880:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541056.419084:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541056.419110:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd000/0xc9a6a13d3cd1b23d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1748 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.419130:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.419135:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541056.419193:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+54:2361:x1875420945370880:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 140us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.419201:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1788541056.423507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.423613:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945371136 00000100:00100000:2.0:1788541056.423624:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945371136 00000100:00100000:2.0:1788541056.423685:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 109 00000100:00100000:2.0:1788541056.423695:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945371136:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541056.423725:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541056.423771:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac174f expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.423876:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.423893:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.423902:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.423937:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.423952:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 55 pid: 5852 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.423966:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968455552:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541056.424061:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541056.427701:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.428085:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968455552:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541056.428117:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541056.428440:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945371264 00000100:00100000:3.0:1788541056.428449:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945371264 00010000:00010000:3.0:1788541056.428488:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 56 pid: 5852 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541056.428532:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1788541056.428543:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:2358:x1875420945371264:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541056.428556:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541056.428563:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 56 pid: 5852 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.428577:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 56 pid: 5852 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.428599:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac173a expref: 56 pid: 5852 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.428615:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541056.428621:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.428632:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.428654:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.428685:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541056.428908:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.428917:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541056.428948:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788541056.429112:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 57 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.429130:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 56 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.429136:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.429139:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541056.429142:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602600, rc 0) 00000100:00100000:3.0:1788541056.429207:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:2358:x1875420945371264:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 665us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.429215:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:2.0:1788541056.430848:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+55:10541:x1875420945371136:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 7147us (7345us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788541056.430860:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 109 00000100:00100000:0.0:1788541056.435656:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.435880:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945371520 00000100:00100000:2.0:1788541056.435892:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945371520 00000100:00100000:2.0:1788541056.435997:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788541056.436030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+55:10541:x1875420945371520:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:2.0:1788541056.436046:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541056.436083:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b1aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1725 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.436103:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.436109:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541056.436171:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945371520:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 144us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.436179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1788541056.438457:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.438734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945371648 00000100:00100000:1.0:1788541056.438745:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945371648 00000100:00100000:1.0:1788541056.438805:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:1.0:1788541056.438816:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945371648:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:1.0:1788541056.438935:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.438966:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.438978:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541056.439207:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788541056.439315:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945371648:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 500us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.439324:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 110 00000100:00100000:1.0:1788541056.443639:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.443846:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945371776 00000100:00100000:2.0:1788541056.443856:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945371776 00000100:00100000:2.0:1788541056.443957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 111 00000100:00100000:2.0:1788541056.443968:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+54:10541:x1875420945371776:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541056.443989:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541056.444011:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1756 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.444071:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.444097:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.444116:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.444130:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.444144:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541056.444147:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541056.444151:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.444160:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603a00, rc 0) 00000100:00100000:2.0:1788541056.444223:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+55:10541:x1875420945371776:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 257us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.444231:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 111 00010000:00010000:1.0:1788541056.601374:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541056.664070:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541056.664090:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541056.664131:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788541056.664137:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541056.664279:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968455680:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541056.664383:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541056.670441:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968455680:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788541056.670837:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.670946:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945371904 00000100:00100000:1.0:1788541056.670954:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945371904 00000100:00100000:1.0:1788541056.671016:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:1.0:1788541056.671027:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:10542:x1875420945371904:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541056.671059:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541056.671202:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:10542:x1875420945371904:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 155us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.671210:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 112 00000100:00100000:1.0:1788541056.680887:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.680993:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945372032 00000100:00100000:0.0:1788541056.681004:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945372032 00000100:00100000:0.0:1788541056.681079:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:0.0:1788541056.681090:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+55:10542:x1875420945372032:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788541056.681167:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681184:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681196:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681262:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681290:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681297:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681324:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681333:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681339:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541056.681380:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788541056.681384:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541056.681397:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681437:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681444:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681450:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681455:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541056.681459:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681473:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681485:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:0.0:1788541056.681489:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541056.681494:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681501:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b267 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681528:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681534:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681540:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681545:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541056.681548:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681555:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681562:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff98d78b22b200) 00010000:00010000:0.0:1788541056.681565:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541056.681567:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681583:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b26e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681600:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681605:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681611:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681617:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541056.681619:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681626:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681633:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:0.0:1788541056.681635:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541056.681639:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.681644:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.681740:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+55:10542:x1875420945372032:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 650us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.681749:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 113 00000100:00100000:0.0:1788541056.688631:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.688720:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945372288 00000100:00100000:1.0:1788541056.688732:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945372288 00000100:00100000:1.0:1788541056.688800:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:1.0:1788541056.688810:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:10542:x1875420945372288:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541056.688831:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.688866:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b27c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac175d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.688970:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.688985:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.688997:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541056.689008:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788541056.689125:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689133:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689139:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689145:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541056.689149:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689157:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689170:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541056.689173:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788541056.689177:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689194:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689249:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b27c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac175d expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689259:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:1.0:1788541056.689261:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541056.689265:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b27c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac175d expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.689274:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031e00, rc 0) 00000100:00100000:1.0:1788541056.689341:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:10542:x1875420945372288:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 533us (720us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788541056.689348:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:3.0:1788541056.701360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.701536:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945372416 00000100:00100000:0.0:1788541056.701547:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945372416 00000100:00100000:0.0:1788541056.701610:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:0.0:1788541056.701621:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+56:10542:x1875420945372416:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541056.701656:0:9724:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541056.701765:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+56:10542:x1875420945372416:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 145us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.701773:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:2.0:1788541056.714532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.718056:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945372672 00000100:00100000:1.0:1788541056.718085:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945372672 00000100:00100000:1.0:1788541056.718170:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:1.0:1788541056.718181:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+56:10542:x1875420945372672:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541056.718204:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.718207:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788541056.718234:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1741 expref: 56 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.718392:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541056.718398:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541056.722814:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b291 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1764 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541056.723323:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788541056.723584:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.723601:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.723613:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.723670:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b291 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1764 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.723690:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1764 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.723699:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78b22b200) 00010000:00010000:0.0:1788541056.723709:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541056.723713:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7e00, rc 0) 00000100:00100000:0.0:1788541056.723800:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+57:10542:x1875420945372672:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 5619us (9279us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788541056.723810:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:1.0:1788541056.727233:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.727433:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945372928 00000100:00100000:0.0:1788541056.727445:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945372928 00000100:00100000:0.0:1788541056.727508:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:0.0:1788541056.727518:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+57:10542:x1875420945372928:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541056.727575:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541056.727602:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1764 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727622:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78b22b200) 00010000:00010000:0.0:1788541056.727634:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541056.727657:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727670:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727680:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727694:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727701:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727729:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727805:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727811:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727817:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727823:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541056.727827:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727834:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727842:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:0.0:1788541056.727845:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541056.727848:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727854:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b2a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727862:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727868:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727880:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727885:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541056.727888:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727893:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727901:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xeadb3b66 (ffff98d78b22bb00) 00010000:00010000:0.0:1788541056.727903:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541056.727906:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.727911:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeadb3b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.728004:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+56:10542:x1875420945372928:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 486us (781us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541056.728012:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:1.0:1788541056.733290:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.733484:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945373056 00000100:00100000:3.0:1788541056.733495:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945373056 00000100:00100000:3.0:1788541056.733553:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:3.0:1788541056.733564:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+56:10542:x1875420945373056:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541056.733585:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541056.733610:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b2b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac176b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.733645:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.733659:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.733672:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.733771:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b2b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.733797:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.733806:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541056.733809:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541056.733813:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd600, rc 0) 00000100:00100000:3.0:1788541056.733869:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+57:10542:x1875420945373056:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 307us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.733876:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:3.0:1788541056.742465:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.742628:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945373312 00000100:00100000:0.0:1788541056.742638:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945373312 00000100:00100000:0.0:1788541056.742706:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:0.0:1788541056.742717:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+57:10542:x1875420945373312:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541056.742807:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.742825:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.742854:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541056.743125:0:9724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788541056.743135:0:9724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341742725694ns, next at 342742723374ns, rc = 0 00000004:00010000:0.0:1788541056.743227:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c69f4a6c reply state 0000000032a342df transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.743366:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541056.746197:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+59:10542:x1875420945373312:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 3469us (3731us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788541056.746216:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 119 00010000:00010000:2.0:1788541056.751623:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.751643:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.751651:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.751657:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541056.751661:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.751670:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.751688:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541056.751691:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788541056.751696:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.751701:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1b2c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541056.751971:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.752199:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945373440 00000100:00100000:1.0:1788541056.752210:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945373440 00000100:00100000:1.0:1788541056.752375:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:1.0:1788541056.752386:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+58:10542:x1875420945373440:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541056.752448:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.752466:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1772 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.752518:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.752531:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.752546:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:1.0:1788541056.752549:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541056.752552:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:1.0:1788541056.752613:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+59:10542:x1875420945373440:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 229us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.752620:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 120 00000100:00100000:1.0:1788541056.755484:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.755571:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945373568 00000100:00100000:2.0:1788541056.755582:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945373568 00000100:00100000:2.0:1788541056.755643:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:2.0:1788541056.755654:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945373568:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788541056.755979:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945373568:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 326us (506us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788541056.756006:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:0.0:1788541056.777359:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.777567:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945373824 00000100:00100000:1.0:1788541056.777577:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945373824 00000100:00100000:1.0:1788541056.777637:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:1.0:1788541056.777648:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+59:10542:x1875420945373824:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788541056.777923:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+60:10542:x1875420945373824:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 276us (575us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788541056.777931:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:3.0:1788541056.779568:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.780396:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374080 00000100:00100000:1.0:1788541056.780434:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374080 00000100:00100000:1.0:1788541056.780503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:1.0:1788541056.780514:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+60:10542:x1875420945374080:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788541056.780637:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+60:10542:x1875420945374080:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 125us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.780645:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:0.0:1788541056.784513:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.784603:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374208 00000100:00100000:1.0:1788541056.784614:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374208 00000100:00100000:1.0:1788541056.784678:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:1.0:1788541056.784690:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+60:10542:x1875420945374208:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541056.784714:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541056.784739:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b2d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1779 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.784812:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b2d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.784827:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.784839:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541056.784900:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541056.784921:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.784947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b2d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1779 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.784967:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1779 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.784977:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:1.0:1788541056.784980:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788541056.784983:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031000, rc 0) 00000100:00100000:1.0:1788541056.789471:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+61:10542:x1875420945374208:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4769us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.789486:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 122 00000100:00100000:0.0:1788541056.796616:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.806453:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374336 00000100:00100000:2.0:1788541056.806472:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374336 00000100:00100000:2.0:1788541056.806564:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1788541056.806576:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:2359:x1875420945374336:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541056.806597:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541056.806617:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1780 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541056.806643:0:9248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af880, blocks: 0x1 00010000:00010000:2.0:1788541056.806663:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1788541056.806668:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541056.806678:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 10 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.806695:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 10 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.806708:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602400, rc 0) 00000100:00100000:2.0:1788541056.806786:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+10:2359:x1875420945374336:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 212us (10182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.806793:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:3.0:1788541056.809538:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.809642:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374592 00000100:00100000:0.0:1788541056.809651:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374592 00000100:00100000:0.0:1788541056.809707:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:0.0:1788541056.809718:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+61:10542:x1875420945374592:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788541056.809836:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+61:10542:x1875420945374592:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.809844:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:0.0:1788541056.815447:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541056.816476:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374720 00000100:00100000:2.0:1788541056.816488:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374720 00000100:00100000:2.0:1788541056.816551:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:2.0:1788541056.816565:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+10:10542:x1875420945374720:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541056.816607:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541056.816631:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1787 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.816668:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.816677:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541056.816682:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541056.816687:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.816723:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.816738:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.816752:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968455808:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541056.816858:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541056.819566:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968455808:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541056.819604:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.819626:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602200, rc 0) 00000100:00100000:2.0:1788541056.819705:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+11:10542:x1875420945374720:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 3142us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.819715:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:2.0:1788541056.830536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.830648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374848 00000100:00100000:0.0:1788541056.830658:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374848 00010000:00010000:0.0:1788541056.830699:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.830767:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:0.0:1788541056.830778:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+11:2358:x1875420945374848:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541056.830799:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541056.830827:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.830842:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.830865:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ea60a8/0xc9a6a13d3cd1b2de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1780 expref: 11 pid: 9248 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.830883:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541056.830888:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541056.830896:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.830906:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.830947:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.830962:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875420968455936:192.168.202.59@tcp:105: 00000100:00100000:0.0:1788541056.831340:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541056.843369:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875420968455936:192.168.202.59@tcp:105: 00010000:00010000:2.0:1788541056.843402:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541056.843495:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:2358:x1875420945374848:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 12717us (12967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.843505:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:1.0:1788541056.861286:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.861445:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945374976 00000100:00100000:3.0:1788541056.861455:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945374976 00002000:00100000:3.0:1788541056.861513:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98d7bf5c8000 x1875420945374976/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:427/0 lens 504/0 e 0 to 0 dl 1788541067 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788541056.861523:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7bf5c8000 with x1875420945374976 ext(0->12) 00002000:00010000:3.0:1788541056.861531:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7bf5c8000 00000100:00100000:2.0:1788541056.861655:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1788541056.861668:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+10:2359:x1875420945374976:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788541056.862852:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+12:2359:x1875420945374976:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 1180us (1569us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788541056.862863:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00002000:00100000:2.0:1788541056.862873:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff98d7bf5c8000 x1875420945374976/t4294967308(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:427/0 lens 504/448 e 0 to 0 dl 1788541067 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541056.862882:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7bf5c8000 with x1875420945374976 ext(0->12) 00002000:00010000:2.0:1788541056.862887:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7bf5c8000 00000100:00100000:2.0:1788541056.877562:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541056.878460:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945375104 00000100:00100000:0.0:1788541056.878474:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945375104 00000100:00100000:0.0:1788541056.878547:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 124 00000100:00100000:0.0:1788541056.878558:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+61:10542:x1875420945375104:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788541056.958136:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+61:10542:x1875420945375104:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 79567us (80573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.958151:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 124 00000001:00080000:1.0:1788541056.959079:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1788541056.959089:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788541056.959170:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788541056.959191:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788541056.959209:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788541056.959230:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d789631540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788541056.959313:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788541056.959323:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788541056.959496:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541056.959515:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968456064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788541056.959580:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541056.959647:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968456064 00000100:00100000:3.0:1788541056.959654:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968456064 00000100:00100000:3.0:1788541056.959700:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788541056.959896:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968456064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788541056.959941:0:9248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788541056.959975:0:9248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9af87f, atime: 0x0, ctime: 0x6a9af87f, blocks: 0xb 00010000:00010000:3.0:1788541056.959983:0:9248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.960000:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788541056.960005:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541056.960012:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.960028:0:9248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.960038:0:9248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.960047:0:9248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541056.960082:0:9248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541056.960325:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541056.960341:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.960360:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541056.960365:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.960373:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.960391:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.960400:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040e05390/0xc9a6a13d3cd1b2ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.960451:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541056.960454:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541056.960455:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788541056.961352:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d790cf7f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d799b7b6c0 00000020:00080000:1.0:1788541056.961358:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b4fdd600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7ad874c00 00000020:00080000:1.0:1788541056.961399:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d78133ad80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788541056.961431:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d78647f240 00000020:00080000:1.0:1788541056.961434:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7ada38400 00000004:00080000:1.0:1788541056.961490:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788541056.961839:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968456320:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788541056.961980:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788541056.962621:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:2.0:1788541056.962818:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7adf9f800/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788541056.962828:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968456064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788541056.962847:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968456192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788541056.962896:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.962961:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968456192 00000100:00100000:2.0:1788541056.962968:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968456192 00000100:00100000:2.0:1788541056.963016:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788541056.963026:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968456192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788541056.963053:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788541056.963098:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.963120:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 11 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.963129:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788541056.963134:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541056.963139:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.963172:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 11 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541056.963187:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 11 pid: 9248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541056.963198:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968456448:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541056.963257:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b63c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788541056.963270:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541056.971143:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1875420968456064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11423us (11552us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788541056.971160:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541056.974162:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.974439:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968456320 00000100:00100000:2.0:1788541056.974449:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968456320 00000100:00100000:2.0:1788541056.974500:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788541056.974510:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968456320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788541056.974755:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788541056.974759:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788541056 00002000:00010000:2.0:1788541056.974762:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788541056.974781:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788541056 -> 1788541056 00002000:00010000:2.0:1788541056.974783:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788541056.974841:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1875420968456320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 332us (688us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788541056.974849:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1788541056.974910:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7bf682d80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788541056.974918:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968456320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788541056.976707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541056.978827:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945375232 00000100:00100000:3.0:1788541056.978848:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945375232 00000100:00100000:3.0:1788541056.978925:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:3.0:1788541056.978935:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+12:2358:x1875420945375232:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788541056.985228:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541056.985429:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968456448:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541056.985461:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.986966:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945375360 00000100:00100000:0.0:1788541056.986978:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945375360 00010000:00010000:0.0:1788541056.987027:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 13 pid: 9248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541056.987084:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:0.0:1788541056.987094:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+13:2358:x1875420945375360:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541056.987106:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541056.987112:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 13 pid: 9248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.987126:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 13 pid: 9248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.987172:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006feb2161/0xc9a6a13d3cd1b0ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16e6 expref: 13 pid: 9248 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.987191:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541056.987196:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541056.987203:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.987213:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541056.987255:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541056.987325:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+12:2358:x1875420945375360:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 231us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.987333:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1788541056.987971:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968456576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541056.988036:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541056.988117:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.988129:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.988141:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.988150:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.988169:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788541056.990393:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968456576 00000100:00100000:0.0:1788541056.990424:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968456576 00000100:00100000:0.0:1788541056.990481:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541056.990491:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875420968456576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541056.990515:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1788541056.990596:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875420968456576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541056.990603:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1788541056.993269:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7ada2ed80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788541056.993285:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968456192:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788541056.993477:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3317:x1875420968456192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30450us (30579us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788541056.993505:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788541056.993546:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541056.993554:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.993566:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541056.993570:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.993920:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.993945:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.993953:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b2f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541056.993975:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541056.993977:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541056.993979:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541056.994020:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968456576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541057.040858:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+11:2358:x1875420945375232:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 61911us (64148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541057.040874:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000001:00080000:3.0:1788541057.043579:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788541057.043603:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788541057.044081:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541057.044184:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945375616 00000100:00100000:2.0:1788541057.044194:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945375616 00000100:00100000:2.0:1788541057.044282:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:2.0:1788541057.044295:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+15:10542:x1875420945375616:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788541057.044356:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541057.044386:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b2d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1779 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.044442:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541057.044449:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541057.044485:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.044501:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.044511:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541057.044967:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087ef9aa4 reply state 00000000068c42f9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541057.044977:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1788541057.045145:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541057.045186:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+16:10542:x1875420945375616:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 893us (1117us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788541057.045195:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 125 00000100:00100000:2.0:1788541057.049046:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541057.049762:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945375744 00000100:00100000:0.0:1788541057.049774:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945375744 00000100:00100000:0.0:1788541057.049876:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1788541057.049890:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945375744:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788541057.050129:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788541057.050134:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788541056 -> 1788541056 00002000:00010000:0.0:1788541057.050136:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788541056 00002000:00010000:0.0:1788541057.050138:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788541056 -> 1788541056 00002000:00010000:0.0:1788541057.050141:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788541057.050205:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945375744:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 318us (1170us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788541057.050214:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00080000:2.0:1788541057.050541:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788541057.056203:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.056222:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.056241:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.056248:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541057.056253:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.056261:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.056277:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541057.056281:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541057.056285:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.056292:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b2fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541057.056516:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541057.056617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376000 00000100:00100000:1.0:1788541057.056628:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376000 00000100:00100000:1.0:1788541057.056676:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:1.0:1788541057.056686:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+15:10542:x1875420945376000:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788541057.056771:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.056786:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.056796:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.056829:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.056845:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 15 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541057.056861:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968456704:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541057.056954:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541057.062403:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541057.063457:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376128 00000100:00100000:1.0:1788541057.063470:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376128 00010000:00010000:1.0:1788541057.063520:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 16 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541057.063568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1788541057.063579:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+16:2358:x1875420945376128:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541057.063612:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541057.063619:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 16 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.063634:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 16 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.063657:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:1.0:1788541057.063663:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.063673:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.063682:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.063704:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541057.063976:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+16:2358:x1875420945376128:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 397us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541057.063984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00010000:00010000:2.0:1788541057.071129:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac176b expref: 15 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541057.071159:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968456704:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541057.071187:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072877:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072893:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072930:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072938:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072946:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072952:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541057.072958:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.072966:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.073005:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:0.0:1788541057.073008:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788541057.073112:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.073119:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b301 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541057.073317:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+14:10542:x1875420945376000:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 16627us (16801us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788541057.073327:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 126 00000100:00100000:1.0:1788541057.089180:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541057.089450:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376256 00000100:00100000:3.0:1788541057.089460:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376256 00000100:00100000:3.0:1788541057.089541:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:3.0:1788541057.089552:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945376256:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788541057.089600:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.089621:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.089630:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788541057.089634:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541057.089639:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.089674:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.089689:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 7 pid: 6705 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541057.089705:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968456832:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541057.089961:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bf694780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541057.094630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541057.094744:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376384 00000100:00100000:0.0:1788541057.094755:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376384 00010000:00010000:0.0:1788541057.094803:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 8 pid: 6705 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541057.094849:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:0.0:1788541057.094860:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945376384:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541057.094876:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541057.094897:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 8 pid: 6705 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.094919:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 8 pid: 6705 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.094948:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541057.094953:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541057.094977:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.094987:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.095010:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541057.095133:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945376384:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 274us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541057.095141:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00010000:00010000:3.0:1788541057.095262:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b2e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1787 expref: 7 pid: 6705 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541057.095277:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968456832:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541057.095300:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095318:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095325:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095349:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095358:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095366:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095373:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cde00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541057.095377:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095387:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095402:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.095463:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf2373b6/0xc9a6a13d3cd1b308 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541057.095513:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945376256:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 5963us (6344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541057.095522:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1788541057.110611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541057.111492:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376640 00000100:00100000:1.0:1788541057.111505:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376640 00000100:00100000:1.0:1788541057.111581:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 127 00000100:00100000:1.0:1788541057.111594:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+14:10542:x1875420945376640:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788541057.111681:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.111739:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.111753:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.112024:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.112036:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.112045:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.112091:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.112105:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 15 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541057.112120:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968456960:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541057.112215:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541057.118488:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541057.118777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376768 00000100:00100000:2.0:1788541057.118787:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376768 00010000:00010000:2.0:1788541057.118830:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 16 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541057.118882:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:2.0:1788541057.118895:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+16:2359:x1875420945376768:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541057.118912:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541057.118936:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 16 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.118951:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 16 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.118979:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541057.118985:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.118997:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.119006:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.119038:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541057.119104:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+16:2359:x1875420945376768:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 211us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541057.119112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00010000:00010000:1.0:1788541057.119574:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b2c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1772 expref: 15 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541057.119592:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968456960:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541057.119612:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.119629:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.119635:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541057.119868:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788541057.120036:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788541057.120092:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788541057.120177:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875420968457088:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788541057.120246:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541057.120283:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786a84cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541057.120379:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968457088 00000100:00100000:3.0:1788541057.120385:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968457088 00000100:00100000:3.0:1788541057.120463:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541057.120472:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875420968457088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788541057.120547:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875420968457088:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541057.120554:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541057.123963:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788541057.123976:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788541057.123999:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7bf682d80, transno 4294967309 00000100:00100000:1.0:1788541057.124027:0:5850:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98d7ada2ed80 x1875420968456192/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788541072 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541057.124042:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875420968457088:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788541057.124527:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788541057.124650:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875420968457216:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788541057.124716:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541057.124762:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541057.124839:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968457216 00000100:00100000:3.0:1788541057.124848:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968457216 00000100:00100000:3.0:1788541057.124909:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541057.124919:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875420968457216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788541057.125137:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1875420968457216:12345-0@lo:1000:mdt00_000.0 Request processed in 219us (419us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788541057.125146:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541057.125433:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875420968457216:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788541057.125467:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125477:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125485:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125491:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541057.125495:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125516:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125532:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d78320d500) 00010000:00010000:0.0:1788541057.125534:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541057.125539:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125545:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b316 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125577:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125584:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125590:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125595:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541057.125598:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125603:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125612:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:0.0:1788541057.125614:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541057.125621:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125643:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125652:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.125680:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541057.125692:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968457344:192.168.202.59@tcp:105: 00000100:00100000:0.0:1788541057.125762:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541057.133589:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541057.133697:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968457344:192.168.202.59@tcp:105: 00010000:00010000:2.0:1788541057.133734:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133745:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b259 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133782:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133796:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133819:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133831:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133837:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133843:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133849:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541057.133853:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133860:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133871:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541057.133874:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541057.133877:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133883:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b31d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133893:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133899:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133911:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133916:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541057.133919:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133926:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133934:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:2.0:1788541057.133937:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541057.133940:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.133946:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b30f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541057.134211:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+18:10542:x1875420945376640:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 22618us (23609us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788541057.134222:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 127 00000020:00080000:2.0:1788541057.134228:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788541057.135267:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541057.135275:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541057.135773:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788541057.135782:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788541057.136363:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541057.137096:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945376896 00000100:00100000:1.0:1788541057.137109:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945376896 00000100:00100000:1.0:1788541057.137158:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945377152 00000100:00100000:1.0:1788541057.137161:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945377152 00000100:00100000:1.0:1788541057.137181:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:1.0:1788541057.137191:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:10541:x1875420945376896:12345-192.168.202.59@tcp:49:lfs.0 00000100:00100000:1.0:1788541057.137376:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:10541:x1875420945376896:12345-192.168.202.59@tcp:49:lfs.0 Request processed in 185us (3795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541057.137403:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:1.0:1788541057.137466:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:1.0:1788541057.137473:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:10542:x1875420945377152:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788541057.138189:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788541057.138297:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788541057.138344:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.138361:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.138373:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.138382:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.138390:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.138396:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.138440:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788541057.138508:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36e9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:10542:x1875420945377152:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 1033us (2147us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788541057.138517:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000020:00080000:1.0:1788541057.138521:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541057.139436:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541057.139445:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.139452:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541057.139466:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.139475:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.139488:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff98d785548800) 00010000:00010000:3.0:1788541057.139492:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788541057.139496:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.139502:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b324 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541057.139521:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541057.139523:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541057.139524:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541057.164861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541057.166475:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945377408 00000100:00100000:0.0:1788541057.166489:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945377408 00000100:00100000:0.0:1788541057.166547:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:0.0:1788541057.166556:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:10541:x1875420945377408:12345-192.168.202.59@tcp:58:lfs.0 00000040:00080000:0.0:1788541057.166804:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788541057.166913:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:10541:x1875420945377408:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 357us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541057.166921:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 128 00000100:00100000:0.0:1788541057.226059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541057.226261:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945377536 00000100:00100000:2.0:1788541057.226272:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945377536 00000100:00100000:2.0:1788541057.226337:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 129 00000100:00100000:2.0:1788541057.226348:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+20:10544:x1875420945377536:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541057.226370:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541057.226392:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b32b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac178e expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.226524:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.226543:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.226556:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.226573:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.226581:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.226589:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.229541:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.229568:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 21 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.229579:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.229625:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 21 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541057.229662:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 21 pid: 9724 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541057.229679:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968457472:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541057.231687:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788541057.241358:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc6b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968457472:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541057.241392:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541057.250221:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541057.250346:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945377792 00000100:00100000:1.0:1788541057.250371:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945377792 00000100:00100000:1.0:1788541057.250465:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:1.0:1788541057.250476:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+22:5597:x1875420945377792:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788541057.250722:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:5597:x1875420945377792:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 247us (511us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788541057.250730:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:3.0:1788541057.253124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541057.253576:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945377920 00000100:00100000:0.0:1788541057.253587:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945377920 00010000:00010000:0.0:1788541057.253631:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 23 pid: 9724 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541057.253679:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:0.0:1788541057.253691:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+23:2359:x1875420945377920:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541057.253710:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541057.253717:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 23 pid: 9724 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.253742:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 23 pid: 9724 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.253765:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b24b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac174f expref: 23 pid: 9724 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.253784:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:0.0:1788541057.253789:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.253800:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.253808:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541057.253850:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541057.253900:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.253910:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541057.253921:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+22:2359:x1875420945377920:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 232us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541057.253928:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000004:00200000:1.0:1788541057.253954:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788541057.253958:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788541057.253977:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.253990:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254000:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254006:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254025:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254031:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541057.254036:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254053:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254063:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:1.0:1788541057.254075:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541057.254079:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254085:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254097:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254102:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254108:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254113:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541057.254115:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254120:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254127:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff98d786553700) 00010000:00010000:1.0:1788541057.254129:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541057.254132:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254146:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254184:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b32b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac178e expref: 22 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254197:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac178e expref: 21 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541057.254205:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541057.254208:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541057.254210:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603200, rc 0) 00000100:00100000:1.0:1788541057.254252:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+21:10544:x1875420945377536:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 27906us (28204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541057.254259:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 129 00010000:00010000:2.0:1788541057.624908:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541058.016190:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968457600:0@lo:400:kworker.0 00000100:00100000:2.0:1788541058.016466:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968457856:0@lo:400:kworker.0 00000100:00100000:2.0:1788541058.016526:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541058.016588:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541058.016594:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968457984:0@lo:400:kworker.0 00000100:00100000:2.0:1788541058.016621:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541058.016699:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968457856 00000100:00100000:0.0:1788541058.016707:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968457856 00000100:00100000:0.0:1788541058.016782:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788541058.016793:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968457856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.016850:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968457856:12345-0@lo:400:kworker.0 Request processed in 59us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541058.016858:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788541058.016884:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968457984 00000100:00100000:0.0:1788541058.016888:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968457984 00000100:00100000:0.0:1788541058.016916:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788541058.016924:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968457984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.016956:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968457984:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541058.016963:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788541058.017005:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968457984:0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.017017:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968457856:0@lo:400:kworker.0 00000100:00080000:2.0:1788541058.017144:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541058.017149:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541058.017285:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541058.017320:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968458112:0@lo:400:kworker.0 00000100:00100000:3.0:1788541058.017343:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541058.017370:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788541058.017376:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968457728:0@lo:400:kworker.0 00000100:00100000:2.0:1788541058.017468:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968457600 00000100:00100000:2.0:1788541058.017473:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968457600 00000100:00100000:2.0:1788541058.017499:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788541058.017506:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968457600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.017595:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968458112 00000100:00100000:0.0:1788541058.017600:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968458112 00000100:00100000:0.0:1788541058.017631:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788541058.017638:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968458112:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788541058.019553:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541058.019688:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d798025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968457600:12345-0@lo:400:kworker.0 Request processed in 2178us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.019700:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788541058.020027:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541058.020117:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968458240:0@lo:400:kworker.0 00000100:00100000:3.0:1788541058.020155:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541058.020200:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968457600:0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.021922:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968458112:12345-0@lo:400:kworker.0 Request processed in 4276us (4569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541058.021938:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788541058.021981:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968457728 00000100:00100000:0.0:1788541058.021988:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968457728 00000100:00100000:2.0:1788541058.022095:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968458240 00000100:00100000:2.0:1788541058.022106:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968458240 00000100:00100000:2.0:1788541058.022153:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541058.022161:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875420968458240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541058.022214:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3316:x1875420968458240:12345-0@lo:400:kworker.0 Request processed in 54us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.022221:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788541058.022257:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541058.026834:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788541058.026857:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968457728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541058.026960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968457728:12345-0@lo:400:kworker.0 Request processed in 113us (6933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541058.026968:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788541058.027524:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968457728:0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.027540:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968458240:0@lo:400:kworker.0 00000100:00100000:0.0:1788541058.027552:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968458112:0@lo:400:kworker.0 00000040:00080000:3.0:1788541058.140878:0:12119:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788541058.140889:0:12119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541058.140937:0:12119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788541058.140947:0:12119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788541058.150696:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541058.150776:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541058.150848:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788541058.150855:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541058.151126:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adee6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968458368:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541058.151239:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786a84cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541058.154817:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adee6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968458368:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541058.157344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541058.157446:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945378048 00000100:00100000:2.0:1788541058.157457:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945378048 00000100:00100000:2.0:1788541058.157520:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:2.0:1788541058.157530:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:10555:x1875420945378048:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788541058.157563:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788541058.157662:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:10555:x1875420945378048:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.157670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 130 00000100:00100000:3.0:1788541058.162198:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541058.162330:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945378304 00000100:00100000:0.0:1788541058.162342:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945378304 00000100:00100000:0.0:1788541058.162435:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 131 00000100:00100000:0.0:1788541058.162448:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+21:10555:x1875420945378304:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541058.162474:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541058.162497:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b347 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1795 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541058.162601:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b34e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541058.162616:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541058.162630:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b34e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541058.162641:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788541058.163528:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b347 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1795 expref: 24 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541058.163565:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b34e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1795 expref: 23 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541058.163573:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:0.0:1788541058.163576:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541058.163579:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6000, rc 0) 00000100:00100000:0.0:1788541058.164107:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+23:10555:x1875420945378304:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1659us (1916us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788541058.164115:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 131 00000100:00100000:3.0:1788541058.177485:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541058.177896:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945378688 00000100:00100000:1.0:1788541058.177911:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945378688 00000100:00100000:1.0:1788541058.177980:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 132 00000100:00100000:1.0:1788541058.177991:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:10555:x1875420945378688:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788541058.178098:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178116:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178130:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178333:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178341:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178347:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178354:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541058.178358:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178366:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178378:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541058.178389:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541058.178395:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541058.178402:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b35c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541058.178575:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+24:10555:x1875420945378688:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 585us (1098us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788541058.178583:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 132 00000040:00080000:3.0:1788541058.179193:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788541058.179199:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541058.179836:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788541058.179848:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541058.189792:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541058.189929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945378432 00000100:00100000:3.0:1788541058.189939:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945378432 00000100:00100000:3.0:1788541058.190013:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1788541058.190024:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+24:2360:x1875420945378432:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541058.190040:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541058.190075:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b34e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1795 expref: 24 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541058.190095:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541058.190100:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541058.190155:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:2360:x1875420945378432:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541058.190163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1788541058.190765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541058.191268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945378944 00000100:00100000:0.0:1788541058.191276:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945378944 00000100:00100000:0.0:1788541058.191320:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:0.0:1788541058.191329:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:10555:x1875420945378944:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541058.191577:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+24:10555:x1875420945378944:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 248us (812us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788541058.191584:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:3.0:1788541058.519684:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541058.519710:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968458496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541058.519785:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541058.519941:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968458496 00000100:00100000:2.0:1788541058.519966:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968458496 00000100:00100000:2.0:1788541058.520015:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788541058.520026:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875420968458496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541058.520074:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541058.520131:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875420968458496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.520139:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788541058.520337:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968458496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541058.649476:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541059.672717:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541059.898989:0:12170:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541059.898999:0:12170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541059.899958:0:12170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788541059.899969:0:12170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541060.163289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541060.163543:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379200 00000100:00100000:1.0:1788541060.163555:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379200 00000100:00100000:1.0:1788541060.163736:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00100000:1.0:1788541060.163747:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+24:10577:x1875420945379200:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:1.0:1788541060.163873:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541060.163900:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b363 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac179c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.164214:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b36a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.164230:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b36a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.164243:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b36a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541060.164271:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788541060.164583:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b363 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac179c expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.164605:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b36a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac179c expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.164613:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541060.164616:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788541060.164619:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031c00, rc 0) 00000100:00100000:1.0:1788541060.164683:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+26:10577:x1875420945379200:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 938us (1406us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788541060.164690:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 133 00000100:00080000:2.0:1788541060.164769:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541060.175680:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541060.175881:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379328 00000100:00100000:1.0:1788541060.175892:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379328 00000100:00100000:1.0:1788541060.175954:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00100000:1.0:1788541060.175964:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+26:10577:x1875420945379328:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:1.0:1788541060.176037:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176068:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176080:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176210:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176226:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176233:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176239:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541060.176244:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176252:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176264:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:1.0:1788541060.176267:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541060.176271:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541060.176277:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b378 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541060.176539:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+26:10577:x1875420945379328:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 575us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541060.176548:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 134 00000100:00100000:0.0:1788541060.308887:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541060.309150:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379456 00000100:00100000:2.0:1788541060.309161:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379456 00000100:00100000:2.0:1788541060.309384:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1788541060.309398:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+6:2361:x1875420945379456:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1788541060.309566:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541060.309593:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002db1262c/0xc9a6a13d3cd1b37f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17a3 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541060.309621:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9af880, atime: 0x6a9af880, ctime: 0x6a9af880, blocks: 0xb 00010000:00010000:2.0:1788541060.309643:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1788541060.309648:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541060.309657:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002db1262c/0xc9a6a13d3cd1b37f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17a3 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541060.309678:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002db1262c/0xc9a6a13d3cd1b37f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17a3 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541060.309690:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603000, rc 0) 00000100:00100000:2.0:1788541060.309761:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2361:x1875420945379456:12345-192.168.202.59@tcp:101:cat.0 Request processed in 367us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541060.309768:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00080000:1.0:1788541060.309825:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541060.319155:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541060.319257:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379584 00000100:00100000:0.0:1788541060.319269:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379584 00002000:00100000:0.0:1788541060.319319:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98d7adc68000 x1875420945379584/t0(0) o3->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:431/0 lens 488/0 e 0 to 0 dl 1788541071 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541060.319330:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7adc68000 with x1875420945379584 ext(0->4095) 00002000:00010000:0.0:1788541060.319335:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7adc68000 00000100:00100000:0.0:1788541060.319398:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1788541060.319443:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945379584:12345-192.168.202.59@tcp:3:cat.0 00000100:00100000:0.0:1788541060.319669:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945379584:12345-192.168.202.59@tcp:3:cat.0 Request processed in 262us (525us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788541060.319677:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00002000:00100000:0.0:1788541060.319684:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff98d7adc68000 x1875420945379584/t0(0) o3->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:431/0 lens 488/4536 e 0 to 0 dl 1788541071 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541060.319692:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7adc68000 with x1875420945379584 ext(0->4095) 00002000:00010000:0.0:1788541060.319696:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7adc68000 00010000:00010000:3.0:1788541060.695785:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541061.221626:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788541061.221649:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:3.0:1788541061.243551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541061.243669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541061.243781:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379968 00000100:00100000:2.0:1788541061.243793:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379968 00000100:00100000:2.0:1788541061.243874:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:2.0:1788541061.243906:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945379968:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541061.244010:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945379968:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 107us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541061.244017:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00080000:2.0:1788541061.244053:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541061.244475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541061.244506:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541061.244529:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541061.244553:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380224 00000100:00100000:3.0:1788541061.244558:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380224 00000100:00100000:3.0:1788541061.244596:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379840 00000100:00100000:3.0:1788541061.244600:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379840 00000100:00100000:3.0:1788541061.244621:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:3.0:1788541061.244628:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945380224:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541061.244661:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945380224:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541061.244667:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:3.0:1788541061.244684:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 139 00000100:00100000:3.0:1788541061.244702:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:2358:x1875420945379840:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541061.244728:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:2358:x1875420945379840:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541061.244734:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 139 00000100:00100000:3.0:1788541061.244756:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380096 00000100:00100000:3.0:1788541061.244759:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380096 00000100:00100000:3.0:1788541061.244785:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:3.0:1788541061.244791:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945380096:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541061.244826:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945380096:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541061.244833:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00080000:3.0:1788541061.244979:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541061.247480:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945379712 00000100:00100000:0.0:1788541061.247497:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945379712 00000100:00100000:0.0:1788541061.247555:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 291 00000100:00100000:0.0:1788541061.247565:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945379712:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541061.247638:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945379712:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 74us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.247646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 291 00010000:00010000:1.0:1788541061.721791:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541062.106162:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968458624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541062.106267:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541062.106529:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968458624 00000100:00100000:3.0:1788541062.106538:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968458624 00000100:00100000:3.0:1788541062.106607:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788541062.106618:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968458624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541062.106656:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541062.106710:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968458624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541062.106717:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788541062.106762:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788541062.106767:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788541062.106788:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7adf9f800, transno 4294967304 00000100:00100000:3.0:1788541062.106807:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968458624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788541062.107080:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788541062.176535:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:1.0:1788541062.176579:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788541062.176595:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d787271540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788541062.176601:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7bfda5500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d7872713c0 00000020:00080000:1.0:1788541062.176605:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7bfda5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7b5124c00 00000020:00080000:1.0:1788541062.176625:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788541062.176648:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788541062.176861:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788541062.182275:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788541062.182296:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788541062.182302:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1788541062.744770:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541063.133714:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968458752:0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.133806:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541063.134887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968458752 00000100:00100000:1.0:1788541063.134900:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968458752 00000100:00100000:1.0:1788541063.134962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788541063.134972:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968458752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541063.146168:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968459008:0@lo:400:kworker.0 00000100:00100000:2.0:1788541063.146245:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541063.146300:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541063.146307:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968459136:0@lo:400:kworker.0 00000100:00100000:2.0:1788541063.146354:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541063.146392:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459136 00000100:00100000:2.0:1788541063.146400:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459136 00000100:00100000:2.0:1788541063.146476:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788541063.146485:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968459136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541063.146539:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968459136:12345-0@lo:400:kworker.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541063.146547:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788541063.146593:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968459136:0@lo:400:kworker.0 00000100:00100000:0.0:1788541063.155487:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459008 00000100:00100000:0.0:1788541063.155503:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459008 00000100:00100000:0.0:1788541063.155578:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788541063.155590:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968459008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541063.155704:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968459008:12345-0@lo:400:kworker.0 Request processed in 116us (9458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541063.155711:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788541063.155748:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968458880:0@lo:400:kworker.0 00000100:00100000:0.0:1788541063.155812:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541063.155838:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788541063.155862:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541063.155884:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541063.155891:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968459264:0@lo:400:kworker.0 00000100:00100000:0.0:1788541063.155915:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788541063.155940:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541063.156798:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968458752:12345-0@lo:400:kworker.0 Request processed in 21823us (22987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541063.156809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788541063.157093:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968458880 00000100:00100000:3.0:1788541063.157100:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968458880 00000100:00100000:3.0:1788541063.157133:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459264 00000100:00100000:3.0:1788541063.157136:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459264 00000100:00100000:3.0:1788541063.157166:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541063.157175:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968458880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.157227:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968458880:12345-0@lo:400:kworker.0 Request processed in 54us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541063.157240:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541063.157255:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788541063.157260:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968459264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.157287:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968459264:12345-0@lo:400:kworker.0 Request processed in 27us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541063.157293:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788541063.157312:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459392 00000100:00100000:3.0:1788541063.157316:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459392 00000100:00100000:3.0:1788541063.157344:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788541063.157350:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968459392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.157380:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968459392:12345-0@lo:400:kworker.0 Request processed in 30us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541063.157386:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788541063.157436:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541063.157440:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541063.157472:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968459264:0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.157484:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968458880:0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.157493:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788541063.157498:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7ada2ed80, transno 4294967310 00000004:00080000:3.0:1788541063.157511:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788541063.157531:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968459392:0@lo:400:kworker.0 00000100:00100000:3.0:1788541063.158110:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968458752:0@lo:400:kworker.0 00000100:00100000:2.0:1788541063.161645:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968459008:0@lo:400:kworker.0 00000040:00080000:0.0:1788541063.320081:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541063.320092:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541063.320134:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788541063.320140:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541063.639798:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541063.639825:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968459520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541063.639899:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541063.640078:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459520 00000100:00100000:2.0:1788541063.640086:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459520 00000100:00100000:2.0:1788541063.640150:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788541063.640160:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968459520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541063.640218:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541063.640269:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968459520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541063.640276:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788541063.640321:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968459520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788541063.779163:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541064.685739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541064.685861:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380352 00000100:00100000:0.0:1788541064.685873:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380352 00000100:00100000:0.0:1788541064.685967:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 135 00000100:00100000:0.0:1788541064.685978:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+13:10221:x1875420945380352:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788541064.686133:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+13:10221:x1875420945380352:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 Request processed in 157us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541064.686142:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 135 00000100:00080000:3.0:1788541064.686619:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541064.690937:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541064.691972:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380608 00000100:00100000:0.0:1788541064.691985:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380608 00000100:00100000:0.0:1788541064.692237:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:0.0:1788541064.692249:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:10221:x1875420945380608:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541064.692907:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:10221:x1875420945380608:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 658us (1976us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788541064.692927:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00010000:00010000:3.0:1788541064.792932:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541065.013933:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541065.014313:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380736 00000100:00100000:3.0:1788541065.014322:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380736 00000100:00100000:3.0:1788541065.014485:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 136 00000100:00100000:3.0:1788541065.014496:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+5:11030:x1875420945380736:12345-192.168.202.59@tcp:101:lsof.0 00010000:00010000:3.0:1788541065.014513:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541065.014533:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b386 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17aa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541065.014589:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541065.014603:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541065.014614:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541065.014644:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541065.014647:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541065.014683:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541065.014704:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b386 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541065.014720:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541065.014746:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541065.014749:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541065.014753:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cda00, rc 0) 00000100:00100000:3.0:1788541065.014809:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+6:11030:x1875420945380736:12345-192.168.202.59@tcp:101:lsof.0 Request processed in 316us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541065.014816:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 136 00000100:00080000:0.0:1788541065.016398:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541065.815654:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541066.373959:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541066.374022:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541066.374070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541066.374109:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945381376 00000100:00100000:3.0:1788541066.374120:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945381376 00000100:00100000:0.0:1788541066.374264:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380864 00000100:00100000:0.0:1788541066.374269:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380864 00000100:00100000:0.0:1788541066.374306:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 293 00000100:00100000:0.0:1788541066.374316:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945380864:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541066.374386:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2359:x1875420945380864:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 71us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.374394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 293 00000100:00100000:3.0:1788541066.374537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00100000:3.0:1788541066.374547:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+6:2359:x1875420945381376:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541066.374581:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+6:2359:x1875420945381376:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541066.374588:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00100000:2.0:1788541066.376362:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945381120 00000100:00100000:2.0:1788541066.376378:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945381120 00000100:00100000:2.0:1788541066.376496:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:2.0:1788541066.376507:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2359:x1875420945381120:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541066.376577:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2359:x1875420945381120:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 72us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.376584:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00080000:0.0:1788541066.376903:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541066.386379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541066.386485:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541066.386697:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945381248 00000100:00100000:0.0:1788541066.386705:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945381248 00000100:00100000:0.0:1788541066.386769:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:0.0:1788541066.386778:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945381248:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541066.386833:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945381248:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.386838:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:3.0:1788541066.387917:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945380992 00000100:00100000:3.0:1788541066.387927:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945380992 00000100:00100000:3.0:1788541066.387993:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 144 00000100:00100000:3.0:1788541066.388005:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:2359:x1875420945380992:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541066.388082:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:2359:x1875420945380992:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 81us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541066.388090:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 144 00000100:00080000:1.0:1788541066.388379:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541066.388383:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788541066.839660:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541067.225497:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968459648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541067.225577:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541067.225651:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459648 00000100:00100000:2.0:1788541067.225659:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459648 00000100:00100000:2.0:1788541067.225712:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788541067.225722:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968459648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541067.225755:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541067.225797:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968459648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541067.225815:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788541067.225856:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968459648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788541067.226660:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788541067.261795:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788541067.261826:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788541067.261840:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788541067.261853:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788541067.864571:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541068.119317:0:12373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:57:46 (1788541066) 00000100:00100000:3.0:1788541068.249766:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968459904:0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.249851:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541068.249907:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968460416:0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.249934:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541068.249963:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788541068.249977:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968459776:0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.250007:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541068.250030:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968460288:0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.250051:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541068.250087:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459904 00000100:00100000:3.0:1788541068.250095:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459904 00000100:00100000:3.0:1788541068.250785:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968460288 00000100:00100000:3.0:1788541068.250790:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968460288 00000100:00100000:0.0:1788541068.250840:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788541068.250851:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968459904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541068.250911:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968459904:12345-0@lo:400:kworker.0 Request processed in 63us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541068.250918:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788541068.250936:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788541068.250948:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968460288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541068.250987:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968460288:12345-0@lo:400:kworker.0 Request processed in 39us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541068.250993:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788541068.251030:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968460288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541068.251043:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968459904:0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.251120:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968459776 00000100:00100000:3.0:1788541068.251125:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968459776 00000100:00100000:3.0:1788541068.251223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788541068.251230:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968459776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.251268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3317:x1875420968459776:12345-0@lo:400:kworker.0 Request processed in 39us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541068.251275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:3.0:1788541068.251306:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541068.251326:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968459776:0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.251755:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968460032:0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.251792:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541068.251820:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541068.251827:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968460160:0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.251851:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541068.251883:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968460416 00000100:00100000:2.0:1788541068.251887:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968460416 00000100:00100000:2.0:1788541068.251924:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968460160 00000100:00100000:2.0:1788541068.251927:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968460160 00000100:00100000:2.0:1788541068.251945:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541068.251952:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968460416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.252003:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968460416:12345-0@lo:400:kworker.0 Request processed in 52us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541068.252010:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541068.252026:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788541068.252032:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968460160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.252062:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968460160:12345-0@lo:400:kworker.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541068.252067:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788541068.252084:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968460032 00000100:00100000:2.0:1788541068.252087:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968460032 00000100:00100000:2.0:1788541068.252111:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541068.252117:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968460032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.252458:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968460032:12345-0@lo:400:kworker.0 Request processed in 341us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541068.252465:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541068.252506:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968460160:0@lo:400:kworker.0 00000100:00100000:2.0:1788541068.252517:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968460032:0@lo:400:kworker.0 00000100:00080000:2.0:1788541068.252535:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541068.252539:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541068.252558:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968460416:0@lo:400:kworker.0 00000100:00100000:3.0:1788541068.759956:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541068.760081:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968460544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541068.760157:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541068.760284:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968460544 00000100:00100000:2.0:1788541068.760293:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968460544 00000100:00100000:2.0:1788541068.760346:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788541068.760355:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968460544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541068.760390:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541068.760456:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968460544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541068.760464:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788541068.761819:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968460544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541068.887861:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541069.588650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541069.589075:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945381632 00000100:00100000:3.0:1788541069.589103:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945381632 00000100:00100000:3.0:1788541069.589198:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00100000:3.0:1788541069.589210:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+13:11294:x1875420945381632:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541069.589242:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541069.589266:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b394 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589346:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589363:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589376:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589393:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589399:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589406:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589714:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b3a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589725:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589732:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541069.589749:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788541069.589894:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589903:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589910:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589916:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541069.589920:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589928:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589951:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d78b22b800) 00010000:00010000:3.0:1788541069.589978:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541069.589983:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.589990:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b39b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590002:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590009:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590025:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590030:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4ccc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541069.590033:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590039:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590048:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98d78320d000) 00010000:00010000:3.0:1788541069.590051:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541069.590054:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590059:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590479:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b394 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17b1 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590496:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17b1 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541069.590504:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:3.0:1788541069.590506:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541069.590509:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cdc00, rc 0) 00000100:00100000:3.0:1788541069.590582:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+15:11294:x1875420945381632:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1373us (1941us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788541069.590600:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 137 00000100:00080000:2.0:1788541069.591786:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541069.594634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541069.594921:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945381760 00000100:00100000:3.0:1788541069.594931:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945381760 00000100:00100000:3.0:1788541069.595365:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:3.0:1788541069.595377:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+15:11294:x1875420945381760:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788541069.595546:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+15:11294:x1875420945381760:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 171us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541069.595554:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 138 00000100:00100000:3.0:1788541069.602577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541069.602667:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945381888 00000100:00100000:2.0:1788541069.602677:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945381888 00000100:00100000:2.0:1788541069.602753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1788541069.602764:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+15:2361:x1875420945381888:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541069.602780:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541069.602806:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b3a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17b1 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.602843:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:2.0:1788541069.602849:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541069.602915:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+14:2361:x1875420945381888:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 153us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.602923:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00010000:00010000:1.0:1788541069.911619:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541070.488616:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541070.488624:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541070.490976:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788541070.490995:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788541070.936973:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541071.482689:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.482738:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.482766:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.482788:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.482813:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.482841:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382272 00000100:00100000:2.0:1788541071.482852:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382272 00000100:00100000:2.0:1788541071.482912:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382400 00000100:00100000:2.0:1788541071.482915:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382400 00000100:00100000:2.0:1788541071.482952:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:2.0:1788541071.482963:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945382272:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541071.483043:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945382272:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.483051:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:2.0:1788541071.483069:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:2.0:1788541071.483077:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945382400:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541071.483101:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945382400:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.483107:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:2.0:1788541071.483136:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382528 00000100:00100000:2.0:1788541071.483139:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382528 00000100:00100000:2.0:1788541071.483167:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382144 00000100:00100000:2.0:1788541071.483169:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382144 00000100:00100000:2.0:1788541071.483190:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:2.0:1788541071.483197:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+6:2358:x1875420945382528:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541071.483225:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d9af4bce-162d-4333-8def-621043259a82+6:2358:x1875420945382528:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.483232:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:2.0:1788541071.483245:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 149 00000100:00100000:2.0:1788541071.483251:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:2358:x1875420945382144:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541071.483275:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:2358:x1875420945382144:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.483282:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 149 00000100:00080000:2.0:1788541071.483303:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541071.483307:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541071.483309:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541071.485512:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382016 00000100:00100000:3.0:1788541071.485526:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382016 00000100:00100000:3.0:1788541071.489299:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 295 00000100:00100000:3.0:1788541071.489321:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945382016:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541071.489425:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945382016:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 97us (6732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.489433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 295 00000100:00100000:2.0:1788541071.582164:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.582240:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382656 00000100:00100000:3.0:1788541071.582251:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382656 00000100:00100000:3.0:1788541071.582313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 139 00000100:00100000:3.0:1788541071.582324:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:11337:x1875420945382656:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541071.582344:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541071.582367:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582465:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582480:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582494:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582510:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582517:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582523:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582714:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582722:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582729:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582736:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cde00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541071.582740:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582757:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582769:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541071.582772:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541071.582777:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582783:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582796:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582801:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582806:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582811:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541071.582814:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582820:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582826:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98d78320db00) 00010000:00010000:3.0:1788541071.582828:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541071.582831:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582849:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582882:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17b8 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582893:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541071.582895:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541071.582899:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17b8 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.582908:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4ccc00, rc 0) 00000100:00100000:3.0:1788541071.582989:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:11337:x1875420945382656:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 666us (832us total) trans 0 rc 301/301 00000100:00100000:3.0:1788541071.582996:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 139 00000100:00100000:2.0:1788541071.587649:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.587748:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945382912 00000100:00100000:3.0:1788541071.587758:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945382912 00000100:00100000:3.0:1788541071.587826:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 140 00000100:00100000:3.0:1788541071.587838:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+14:11337:x1875420945382912:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:3.0:1788541071.587902:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541071.587928:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1ad35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15f1 expref: 14 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.587957:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:3.0:1788541071.587963:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541071.588166:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.588185:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 5 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.588194:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.588226:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 5 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.588240:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 5 pid: 5851 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.588253:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf55500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968460672:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541071.588357:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541071.590886:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf55500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968460672:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541071.590889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:3.0:1788541071.590914:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541071.590972:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383040 00000100:00100000:1.0:1788541071.590979:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383040 00010000:00010000:1.0:1788541071.591022:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 6 pid: 5851 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541071.591063:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1788541071.591073:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9af4bce-162d-4333-8def-621043259a82+6:2358:x1875420945383040:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541071.591085:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541071.591091:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 6 pid: 5851 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.591103:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 6 pid: 5851 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.591123:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b38d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17aa expref: 6 pid: 5851 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.591136:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:1.0:1788541071.591140:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.591149:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.591157:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.591184:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541071.591245:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945383040:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 173us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.591261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00010000:00010000:3.0:1788541071.591497:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.591507:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.591530:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.591540:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.591555:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541071.592973:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788541071.592989:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.592998:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.593005:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.593018:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541071.593022:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.593030:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.593044:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d786553900) 00010000:00010000:2.0:1788541071.593047:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541071.593052:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.593058:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b3cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541071.593075:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6e7f4fd reply state 00000000aed0ea4f transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.593084:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541071.593177:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+15:11337:x1875420945382912:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 5337us (5537us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788541071.593185:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 140 00010000:00010000:1.0:1788541071.596080:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.596099:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.596106:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.596112:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4ccc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541071.596116:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.596124:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.596141:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98d78320db00) 00010000:00010000:1.0:1788541071.596144:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541071.596148:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.596154:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b3d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541071.660169:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.660385:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383168 00000100:00100000:3.0:1788541071.660395:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383168 00000100:00100000:3.0:1788541071.660747:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 141 00000100:00100000:3.0:1788541071.660761:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+14:11345:x1875420945383168:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:3.0:1788541071.660787:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541071.660811:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.660878:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.660892:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.660904:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541071.660957:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541071.660961:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541071.660986:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.661012:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b3da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17bf expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.661029:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17bf expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.661053:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:3.0:1788541071.661055:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541071.661059:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cde00, rc 0) 00000100:00100000:3.0:1788541071.661183:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+15:11345:x1875420945383168:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 425us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.661191:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 141 00000100:00100000:2.0:1788541071.722517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.722690:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383296 00000100:00100000:0.0:1788541071.722701:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383296 00000100:00100000:0.0:1788541071.722802:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 142 00000100:00100000:0.0:1788541071.722814:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+15:11351:x1875420945383296:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541071.722834:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541071.722854:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b3e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17c6 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.722917:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.722931:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.722975:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.722992:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.722999:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723025:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723133:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b3fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723141:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723148:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541071.723174:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788541071.723177:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541071.723197:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723209:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723215:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723221:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723226:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541071.723230:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723250:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723269:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:0.0:1788541071.723272:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541071.723278:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723285:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b3ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723299:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723305:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723311:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723317:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541071.723320:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723326:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723333:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff98d78b22bb00) 00010000:00010000:0.0:1788541071.723335:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541071.723338:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723344:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b3f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723385:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b3e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17c6 expref: 17 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723400:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b3fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17c6 expref: 16 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.723458:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:0.0:1788541071.723461:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788541071.723464:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6000, rc 0) 00000100:00100000:0.0:1788541071.723515:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+16:11351:x1875420945383296:12345-192.168.202.59@tcp:101:bash.0 Request processed in 704us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541071.723522:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 142 00000100:00100000:1.0:1788541071.728016:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.728224:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383552 00000100:00100000:2.0:1788541071.728246:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383552 00000100:00100000:2.0:1788541071.728314:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00100000:2.0:1788541071.728325:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+16:11351:x1875420945383552:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541071.728345:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541071.728365:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b404 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.728876:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.728892:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.728904:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.728918:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.728924:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.728933:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541071.730097:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788541071.730368:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730381:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730390:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730533:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730552:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730558:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730564:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541071.730568:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730576:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730598:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541071.730602:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541071.730608:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730613:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b40b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541071.730628:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bb6166d reply state 00000000819b9160 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.730637:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788541071.730672:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b404 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730688:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.730706:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541071.730708:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541071.730711:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602400, rc 0) 00000100:00100000:2.0:1788541071.730932:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+19:11351:x1875420945383552:12345-192.168.202.59@tcp:101:bash.0 Request processed in 2609us (2926us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788541071.730953:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 143 00000100:00100000:1.0:1788541071.735783:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.736066:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383680 00000100:00100000:2.0:1788541071.736078:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383680 00000100:00100000:2.0:1788541071.736158:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1788541071.736168:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945383680:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541071.736186:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541071.736207:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17d4 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541071.736242:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788541071.736265:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1788541071.736271:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541071.736280:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.736298:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.736310:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541071.736369:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945383680:12345-192.168.202.59@tcp:101:bash.0 Request processed in 202us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.736392:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00010000:00010000:3.0:1788541071.739724:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.739743:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.739751:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.739756:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541071.739761:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.739769:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.739785:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553900) 00010000:00010000:3.0:1788541071.739788:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541071.739793:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.739799:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b412 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.740064:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.740304:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383808 00000100:00100000:0.0:1788541071.740315:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383808 00000100:00100000:0.0:1788541071.740404:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1788541071.740453:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+6:11351:x1875420945383808:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541071.740470:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541071.740486:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17db expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.740515:0:9248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.740524:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541071.740528:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541071.740533:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.740576:0:9248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.740600:0:9248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541071.740616:0:9248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968460800:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541071.740713:0:9248:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bf694b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541071.743717:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.743839:0:9248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968460800:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541071.743873:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 7 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.743894:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6600, rc 0) 00000100:00100000:0.0:1788541071.743981:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:11351:x1875420945383808:12345-192.168.202.59@tcp:101:bash.0 Request processed in 3532us (3920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541071.743990:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:2.0:1788541071.744637:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945383936 00000100:00100000:2.0:1788541071.744647:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945383936 00010000:00010000:2.0:1788541071.744682:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.744722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:2.0:1788541071.744731:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945383936:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541071.744743:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541071.744764:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.744777:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.744801:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b427 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17d4 expref: 7 pid: 6706 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.744815:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541071.744820:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541071.744828:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.744839:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.744891:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.744906:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875420968460928:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541071.744986:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541071.748059:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875420968460928:192.168.202.59@tcp:105: 00010000:00010000:2.0:1788541071.748088:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541071.748146:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2358:x1875420945383936:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 3415us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.748157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:1.0:1788541071.751887:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.752019:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945384192 00000100:00100000:0.0:1788541071.752030:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945384192 00000100:00100000:0.0:1788541071.752127:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:0.0:1788541071.752139:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:11351:x1875420945384192:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1788541071.752548:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:11351:x1875420945384192:12345-192.168.202.59@tcp:35:bash.0 Request processed in 410us (671us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788541071.752556:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:3.0:1788541071.817742:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.817806:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945384448 00000100:00100000:2.0:1788541071.817817:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945384448 00000100:00100000:2.0:1788541071.818081:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 144 00000100:00100000:2.0:1788541071.818094:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+19:11361:x1875420945384448:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541071.818116:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541071.818138:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541071.818539:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788541071.818667:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b435 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17e2 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.818683:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:2.0:1788541071.818893:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541071.818913:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17e2 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.818929:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541071.819180:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+20:11361:x1875420945384448:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1088us (1445us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788541071.819188:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 144 00000100:00100000:1.0:1788541071.824439:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.824534:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945384704 00000100:00100000:2.0:1788541071.824545:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945384704 00000100:00100000:2.0:1788541071.824647:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:2.0:1788541071.824658:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+20:11361:x1875420945384704:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541071.824917:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+21:11361:x1875420945384704:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 260us (513us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788541071.824925:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:1.0:1788541071.884276:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.884435:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945384832 00000100:00100000:3.0:1788541071.884448:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945384832 00000100:00100000:3.0:1788541071.884512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 145 00000100:00100000:3.0:1788541071.884520:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:11367:x1875420945384832:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541071.884542:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541071.884564:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17e9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.884637:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b44a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.884653:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b44a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.884668:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b44a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541071.884705:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788541071.884710:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541071.884728:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b44a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.884755:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17e9 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.884770:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b44a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17e9 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.884789:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541071.884791:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541071.884795:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd000, rc 0) 00000100:00100000:3.0:1788541071.884847:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+22:11367:x1875420945384832:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 328us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.884852:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 145 00000100:00100000:3.0:1788541071.887785:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.888025:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945385088 00000100:00100000:0.0:1788541071.888036:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945385088 00000100:00100000:0.0:1788541071.888162:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 146 00000100:00100000:0.0:1788541071.888173:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+22:11367:x1875420945385088:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541071.888202:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541071.888224:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17f0 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.888336:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.888350:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.888363:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541071.888372:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788541071.888553:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f0 expref: 25 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.888571:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f0 expref: 24 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.888579:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:0.0:1788541071.888582:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541071.888586:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6800, rc 0) 00000100:00100000:0.0:1788541071.888657:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+24:11367:x1875420945385088:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 486us (879us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788541071.888682:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 146 00000100:00100000:1.0:1788541071.891494:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.891583:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945385344 00000100:00100000:3.0:1788541071.891593:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945385344 00000100:00100000:3.0:1788541071.891659:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 147 00000100:00100000:3.0:1788541071.891671:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+24:11367:x1875420945385344:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541071.891694:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541071.891716:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b466 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17f7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.891813:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b46d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.891828:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b46d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.891840:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b46d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541071.891853:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788541071.891991:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f7 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.892029:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b46d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f7 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.892038:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:3.0:1788541071.892042:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788541071.892046:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc800, rc 0) 00000100:00100000:3.0:1788541071.892104:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+26:11367:x1875420945385344:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 435us (619us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788541071.892111:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 147 00000100:00100000:1.0:1788541071.898016:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.898113:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945385472 00000100:00100000:3.0:1788541071.898125:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945385472 00000100:00100000:3.0:1788541071.898182:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1788541071.898192:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945385472:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:3.0:1788541071.898241:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.898264:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.898273:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541071.898278:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541071.898282:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.898318:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 6 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.898349:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 6 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.898363:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875420968461056:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541071.898482:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541071.899523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541071.899608:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945385600 00000100:00100000:1.0:1788541071.899615:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945385600 00000100:00100000:1.0:1788541071.899671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1788541071.899681:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+26:2359:x1875420945385600:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541071.899696:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541071.899720:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f0 expref: 26 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.899739:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:1.0:1788541071.899745:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541071.899794:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+25:2359:x1875420945385600:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 115us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.899802:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1788541071.900866:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875420968461056:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541071.900894:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.902350:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.902658:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945385728 00000100:00100000:0.0:1788541071.902670:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945385728 00002000:00100000:0.0:1788541071.902733:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98d7adf57b80 x1875420945385728/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:442/0 lens 504/0 e 0 to 0 dl 1788541082 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541071.902745:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7adf57b80 with x1875420945385728 ext(0->12) 00010000:00010000:0.0:1788541071.902753:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 7 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.902769:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 7 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541071.902775:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d7adf57b80 00000100:00100000:0.0:1788541071.902809:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:0.0:1788541071.902819:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945385728:12345-192.168.202.59@tcp:4:lfs.0 00000100:00100000:1.0:1788541071.903979:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:2359:x1875420945385728:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 1153us (1628us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788541071.903990:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00002000:00100000:1.0:1788541071.904000:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff98d7adf57b80 x1875420945385728/t4294967305(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:442/0 lens 504/448 e 0 to 0 dl 1788541082 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541071.904009:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7adf57b80 with x1875420945385728 ext(0->12) 00010000:00010000:1.0:1788541071.904017:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 9 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.904048:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 9 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541071.904056:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d7adf57b80 00000100:00100000:1.0:1788541071.907573:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541071.907728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945385856 00000100:00100000:0.0:1788541071.907742:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945385856 00010000:00010000:0.0:1788541071.907786:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 9 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541071.907868:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:0.0:1788541071.907879:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945385856:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541071.907895:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788541071.907916:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788541071.907919:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788541071 00002000:00010000:0.0:1788541071.907947:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788541071 00002000:00010000:0.0:1788541071.907949:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788541071 00010000:00010000:0.0:1788541071.907957:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 9 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.907972:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 9 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.907997:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b42e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17db expref: 9 pid: 9248 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.908015:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541071.908020:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541071.908026:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.908037:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.908073:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541071.908148:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945385856:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 270us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541071.908155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00010000:00010000:3.0:1788541071.908205:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908215:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908253:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908262:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908270:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908285:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cce00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541071.908289:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908298:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908311:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.908318:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acf5d238/0xc9a6a13d3cd1b47b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.908369:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945385472:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 10178us (10365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.908378:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:1.0:1788541071.910874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.910967:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945386112 00000100:00100000:3.0:1788541071.910977:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945386112 00000100:00100000:3.0:1788541071.911038:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1788541071.911049:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+25:11367:x1875420945386112:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:3.0:1788541071.911123:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b46d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f7 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541071.911379:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788541071.911458:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788541071.912380:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788541071.912484:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.912503:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.912512:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.912553:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.912569:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 29 pid: 5852 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.912584:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1875420968461184:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541071.913019:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782e49480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541071.917704:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf57480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5854:1875420968461184:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541071.917741:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541071.919291:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541071.919382:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945386240 00000100:00100000:3.0:1788541071.919392:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945386240 00010000:00010000:3.0:1788541071.919480:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 30 pid: 5852 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.919519:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:3.0:1788541071.919529:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+30:2359:x1875420945386240:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541071.919546:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541071.919552:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 30 pid: 5852 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.919565:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 30 pid: 5852 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.919733:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17cd expref: 30 pid: 5852 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.919752:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:3.0:1788541071.919757:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.919766:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.919773:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.919806:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541071.920014:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541071.920023:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541071.920159:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788541071.920357:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788541071.920501:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968461312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788541071.920555:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541071.920582:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bf694d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541071.920725:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+31:2359:x1875420945386240:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1196us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.920734:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:2.0:1788541071.920910:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968461312 00000100:00100000:2.0:1788541071.920916:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968461312 00000100:00100000:2.0:1788541071.920983:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541071.920993:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875420968461312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788541071.921070:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875420968461312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.921077:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541071.921126:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968461312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788541071.921704:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788541071.921773:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968461440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788541071.921809:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541071.921828:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78656f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541071.921849:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968461440 00000100:00100000:2.0:1788541071.921853:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968461440 00000100:00100000:2.0:1788541071.921873:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541071.921879:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875420968461440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788541071.922035:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1875420968461440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 156us (226us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788541071.922042:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541071.922080:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf9f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5854:1875420968461440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788541071.922120:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788541071.922152:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.922161:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.922168:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.922174:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541071.922179:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.922188:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.922203:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541071.922207:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788541071.922211:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.922216:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b482 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541071.922391:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788541071.922544:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788541071.922556:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356922146251ns, next at 357922144010ns, rc = 0 00000001:00080000:2.0:1788541071.922563:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00080000:3.0:1788541071.923310:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788541071.923540:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541071.923545:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788541071.923555:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b46d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17f7 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.923732:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:11367:x1875420945386112:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 12684us (12867us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788541071.923741:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000020:00080000:2.0:1788541071.923746:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788541071.926926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.927043:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945386368 00000100:00100000:2.0:1788541071.927053:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945386368 00000100:00100000:2.0:1788541071.927159:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:2.0:1788541071.927170:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:11367:x1875420945386368:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541071.927195:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541071.927218:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac17fe expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.927312:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17fe expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.927330:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17fe expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.927374:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541071.927378:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541071.927381:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603800, rc 0) 00000100:00100000:2.0:1788541071.927474:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+33:11367:x1875420945386368:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 305us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.927481:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 148 00000100:00100000:1.0:1788541071.933828:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541071.933941:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945386624 00000100:00100000:2.0:1788541071.933956:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945386624 00000100:00100000:2.0:1788541071.934066:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:2.0:1788541071.934078:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+33:11367:x1875420945386624:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541071.934997:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+34:11367:x1875420945386624:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 917us (1179us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788541071.935008:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00010000:00010000:1.0:1788541071.961511:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541071.999925:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541072.000199:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945386880 00000100:00100000:3.0:1788541072.000210:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945386880 00000100:00100000:3.0:1788541072.000381:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 149 00000100:00100000:3.0:1788541072.000393:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+34:11377:x1875420945386880:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541072.000459:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541072.000483:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1805 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541072.000582:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788541072.000724:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b490 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1805 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.000751:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:3.0:1788541072.000754:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541072.000760:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1805 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.000774:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cce00, rc 0) 00000100:00100000:3.0:1788541072.000841:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:11377:x1875420945386880:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 450us (925us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788541072.000849:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 149 00000100:00100000:1.0:1788541072.005713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541072.005830:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945387008 00000100:00100000:0.0:1788541072.005841:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945387008 00000100:00100000:0.0:1788541072.005899:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 150 00000100:00100000:0.0:1788541072.005909:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+35:11377:x1875420945387008:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1788541072.005995:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006014:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006029:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006044:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006051:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006075:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006391:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006401:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006482:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541072.006527:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006541:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006548:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006555:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006560:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541072.006565:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006572:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006586:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:0.0:1788541072.006678:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541072.006684:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006691:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b49e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006706:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006712:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006718:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006724:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541072.006726:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006732:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006741:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78b22bb00) 00010000:00010000:0.0:1788541072.006743:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541072.006746:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006752:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b4a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006768:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006780:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006786:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006790:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541072.006793:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006800:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006807:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:0.0:1788541072.006810:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541072.006813:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.006819:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b4ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541072.006970:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+35:11377:x1875420945387008:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1059us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541072.006979:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 150 00000100:00100000:2.0:1788541072.009712:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541072.009836:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945387264 00000100:00100000:0.0:1788541072.009848:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945387264 00000100:00100000:0.0:1788541072.009949:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:0.0:1788541072.009959:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:11377:x1875420945387264:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541072.010232:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+36:11377:x1875420945387264:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 272us (531us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788541072.010262:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:1.0:1788541072.050850:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.050949:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945387520 00000100:00100000:2.0:1788541072.050958:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945387520 00000100:00100000:2.0:1788541072.051025:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 151 00000100:00100000:2.0:1788541072.051035:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+36:11380:x1875420945387520:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541072.051058:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541072.051079:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac180c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051156:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051171:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051201:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051217:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051224:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051230:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051536:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051542:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051547:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541072.051554:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788541072.051689:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051695:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051699:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051703:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.051711:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051717:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051726:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541072.051729:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541072.051732:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051737:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b4ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051745:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051749:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051752:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051756:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.051757:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051760:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051764:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553700) 00010000:00010000:2.0:1788541072.051765:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541072.051770:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051774:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b4c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051807:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051815:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.051819:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541072.051821:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541072.051823:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603600, rc 0) 00000100:00100000:2.0:1788541072.051914:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+38:11380:x1875420945387520:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 881us (1074us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788541072.051919:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 151 00000100:00100000:1.0:1788541072.055076:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.055225:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945387648 00000100:00100000:2.0:1788541072.055285:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945387648 00000100:00100000:2.0:1788541072.055389:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 152 00000100:00100000:2.0:1788541072.055400:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+38:11380:x1875420945387648:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1788541072.055493:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055509:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055521:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055566:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055573:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055580:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055793:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.055799:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055807:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055818:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541072.055821:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541072.055825:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.055831:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541072.055946:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+38:11380:x1875420945387648:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 548us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541072.055953:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 152 00000100:00100000:1.0:1788541072.058789:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.059004:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945387904 00000100:00100000:2.0:1788541072.059014:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945387904 00000100:00100000:2.0:1788541072.059066:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:2.0:1788541072.059086:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+38:11380:x1875420945387904:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541072.059319:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+39:11380:x1875420945387904:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 235us (538us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788541072.059327:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:1.0:1788541072.305353:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541072.305479:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945388160 00000100:00100000:3.0:1788541072.305489:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945388160 00000100:00100000:3.0:1788541072.305557:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 153 00000100:00100000:3.0:1788541072.305569:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+39:11411:x1875420945388160:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:3.0:1788541072.305662:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541072.305687:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b4dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1813 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.305804:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b4e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.305821:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.305836:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541072.305847:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788541072.306016:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b4dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1813 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.306035:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1813 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.306043:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541072.306045:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541072.306049:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cca00, rc 0) 00000100:00100000:3.0:1788541072.306324:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+41:11411:x1875420945388160:12345-192.168.202.59@tcp:101:cat.0 Request processed in 756us (981us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788541072.306333:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 153 00000100:00100000:1.0:1788541072.310682:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541072.310732:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541072.310810:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945388544 00000100:00100000:3.0:1788541072.310821:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945388544 00000100:00100000:3.0:1788541072.310894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788541072.310904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+41:2361:x1875420945388544:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541072.310919:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541072.310954:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b4e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1813 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.310973:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541072.310979:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541072.311031:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+40:2361:x1875420945388544:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 129us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541072.311039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:2.0:1788541072.311207:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945388416 00000100:00100000:2.0:1788541072.311212:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945388416 00000100:00100000:2.0:1788541072.311251:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1788541072.311259:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+40:11411:x1875420945388416:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:2.0:1788541072.311495:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+41:11411:x1875420945388416:12345-192.168.202.59@tcp:35:cat.0 Request processed in 237us (823us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788541072.311503:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:2.0:1788541072.345046:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541072.345076:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968461568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541072.345175:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541072.345305:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968461568 00000100:00100000:3.0:1788541072.345313:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968461568 00000100:00100000:3.0:1788541072.345381:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788541072.345390:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7aed1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968461568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541072.345434:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541072.345484:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7aed1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968461568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541072.345491:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788541072.345691:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968461568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541072.391302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.391599:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945388800 00000100:00100000:2.0:1788541072.391610:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945388800 00000100:00100000:2.0:1788541072.391675:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 154 00000100:00100000:2.0:1788541072.391688:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+41:11417:x1875420945388800:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:2.0:1788541072.391712:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541072.391715:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788541072.391741:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b44a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17e9 expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.391760:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541072.391778:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541072.391794:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac181a expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.391889:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.391902:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.391911:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.391959:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.391973:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 41 pid: 5852 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541072.391987:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968461696:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541072.392077:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541072.398171:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.398224:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968461696:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541072.398264:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541072.398294:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945388928 00000100:00100000:2.0:1788541072.398301:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945388928 00010000:00010000:2.0:1788541072.398338:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 42 pid: 5852 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541072.398386:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:2.0:1788541072.398397:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+42:2359:x1875420945388928:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541072.398429:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541072.398437:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 42 pid: 5852 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398450:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 42 pid: 5852 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398472:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b4c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac180c expref: 42 pid: 5852 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398489:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541072.398494:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398503:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398511:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398533:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541072.398594:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+41:2359:x1875420945388928:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 188us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541072.398603:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00010000:00010000:2.0:1788541072.398632:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398648:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541072.398667:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788541072.398950:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b4f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 42 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398966:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 41 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.398975:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541072.398977:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541072.398980:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:2.0:1788541072.399007:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+41:11417:x1875420945388800:12345-192.168.202.59@tcp:101:dd.0 Request processed in 7323us (7715us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788541072.399014:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 154 00000100:00100000:2.0:1788541072.402870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541072.402945:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945389184 00000100:00100000:0.0:1788541072.402955:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945389184 00000100:00100000:0.0:1788541072.403014:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 155 00000100:00100000:0.0:1788541072.403025:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+41:11417:x1875420945389184:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:0.0:1788541072.403316:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.403332:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.403343:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541072.403392:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788541072.403453:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e304464c reply state 00000000bc1a5d3a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541072.403461:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541072.403550:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+44:11417:x1875420945389184:12345-192.168.202.59@tcp:36:dd.0 Request processed in 527us (687us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788541072.403557:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 155 00000020:00080000:0.0:1788541072.403562:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788541072.409374:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.409392:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.409399:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.409436:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541072.409441:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.409449:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.409467:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:1.0:1788541072.409470:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541072.409475:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.409482:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541072.460389:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000001:00080000:2.0:1788541072.460452:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000004:00080000:2.0:1788541072.460468:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788541072.460484:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d78656fa80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788541072.460490:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7bb4cbe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d78656f780 00000020:00080000:2.0:1788541072.460494:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7bb4cba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7899bc000 00000100:00100000:3.0:1788541072.460770:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541072.460796:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968461824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788541072.460871:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541072.460963:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968461824 00000100:00100000:3.0:1788541072.460972:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968461824 00000100:00100000:3.0:1788541072.461031:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788541072.461042:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968461824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788541072.461073:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788541072.461331:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9af88f, atime: 0x6a9af88f, ctime: 0x6a9af88f, blocks: 0x1 00010000:00010000:3.0:1788541072.461340:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.461356:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788541072.461361:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541072.461368:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.461383:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.461394:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.461435:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.461453:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1788541072.465781:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788541072.465938:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788541072.466991:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541072.467003:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.467030:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cca00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541072.467034:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.467046:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.467067:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.467076:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c02929/0xc9a6a13d3cd1b50e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.467113:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541072.467115:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541072.467117:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541072.467402:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1875420968461824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6357us (6526us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788541072.467433:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1788541072.467679:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7adf54e00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788541072.467686:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968461824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788541072.656967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541072.657071:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945389312 00000100:00100000:1.0:1788541072.657082:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945389312 00000100:00100000:1.0:1788541072.657152:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 156 00000100:00100000:1.0:1788541072.657163:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+19:11431:x1875420945389312:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:1.0:1788541072.657186:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541072.657207:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1821 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657274:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657290:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657317:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657333:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657341:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657348:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657690:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657703:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 20 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657711:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657747:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 20 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541072.657761:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 20 pid: 9724 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541072.657775:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968461952:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541072.657879:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b3783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541072.660788:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968461952:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541072.660820:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541072.661958:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541072.662230:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945389568 00000100:00100000:1.0:1788541072.662240:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945389568 00000100:00100000:1.0:1788541072.662299:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1788541072.662310:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+21:9232:x1875420945389568:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788541072.662735:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+22:9232:x1875420945389568:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 426us (781us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788541072.662744:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1788541072.666766:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541072.666864:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945389696 00000100:00100000:3.0:1788541072.666877:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945389696 00010000:00010000:3.0:1788541072.666935:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 22 pid: 9724 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541072.667011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:3.0:1788541072.667021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+22:2359:x1875420945389696:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541072.667036:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541072.667043:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 22 pid: 9724 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.667057:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 22 pid: 9724 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.667079:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b4f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac181a expref: 22 pid: 9724 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.667164:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541072.667184:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.667195:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.667203:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.667302:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541072.667391:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+21:2359:x1875420945389696:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 370us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541072.667400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00010000:00010000:2.0:1788541072.668824:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.668852:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541072.668902:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788541072.668907:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541072.668945:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.668960:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.668970:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.668977:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.668984:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.668990:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.668994:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669003:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669015:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541072.669019:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541072.669023:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669041:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b51c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669059:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669066:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669072:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669076:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.669080:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669085:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669464:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d785548b00) 00010000:00010000:2.0:1788541072.669468:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541072.669472:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669480:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669524:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1b515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1821 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669538:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1821 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.669552:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541072.669555:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541072.669557:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780030000, rc 0) 00000100:00100000:2.0:1788541072.669745:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+20:11431:x1875420945389312:12345-192.168.202.59@tcp:101:stat.0 Request processed in 12583us (12787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541072.669754:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 156 00000100:00100000:1.0:1788541072.724533:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541072.724652:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945389952 00000100:00100000:0.0:1788541072.724662:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945389952 00000100:00100000:0.0:1788541072.724731:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 157 00000100:00100000:0.0:1788541072.724743:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:11437:x1875420945389952:12345-192.168.202.59@tcp:36:truncate.0 00010000:00010000:0.0:1788541072.724807:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541072.724849:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780030000/0xc9a6a13d3cd1b52a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1821 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.724873:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:0.0:1788541072.724878:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541072.725330:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.725346:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541072.725356:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541072.725463:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788541072.725488:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fcbdefe reply state 000000002ba9506f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541072.725496:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541072.725592:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+22:11437:x1875420945389952:12345-192.168.202.59@tcp:36:truncate.0 Request processed in 851us (1072us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788541072.725600:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 157 00000020:00080000:0.0:1788541072.725604:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541072.728652:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.728671:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.728678:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.728683:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541072.728689:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.728697:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.728716:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541072.728720:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541072.728724:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541072.728745:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541072.849651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.849894:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945390080 00000100:00100000:2.0:1788541072.849908:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945390080 00000100:00100000:2.0:1788541072.850031:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 158 00000100:00100000:2.0:1788541072.850044:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+21:11451:x1875420945390080:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:2.0:1788541072.850071:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541072.850104:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1828 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850174:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850197:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850214:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850230:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850237:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850262:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850583:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850594:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850601:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541072.850819:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788541072.850825:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541072.850850:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850862:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850870:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850877:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850884:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850892:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.850898:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850913:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850935:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541072.850938:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541072.850944:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850951:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b53f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850965:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850971:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850977:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850983:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541072.850986:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850991:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.850997:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553700) 00010000:00010000:2.0:1788541072.851000:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541072.851002:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.851021:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.851060:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 23 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.851073:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 22 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.851081:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541072.851083:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541072.851086:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603e00, rc 0) 00000100:00100000:2.0:1788541072.851173:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+22:11451:x1875420945390080:12345-192.168.202.59@tcp:101:stat.0 Request processed in 1132us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541072.851180:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 158 00000100:00100000:0.0:1788541072.926471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541072.926577:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945390336 00000100:00100000:2.0:1788541072.926587:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945390336 00000100:00100000:2.0:1788541072.926662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 159 00000100:00100000:2.0:1788541072.926674:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+22:11460:x1875420945390336:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541072.926694:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541072.926715:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac182f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541072.926811:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788541072.926939:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b554 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac182f expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.926971:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:2.0:1788541072.926973:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541072.926979:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac182f expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541072.926993:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603600, rc 0) 00000100:00100000:2.0:1788541072.927054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+23:11460:x1875420945390336:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 382us (593us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788541072.927061:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 159 00000100:00100000:0.0:1788541072.930334:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541072.931199:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945390592 00000100:00100000:1.0:1788541072.931212:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945390592 00000100:00100000:1.0:1788541072.931288:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:1.0:1788541072.931298:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+23:11460:x1875420945390592:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1788541072.933302:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+24:11460:x1875420945390592:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 280us (1254us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788541072.933328:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00010000:00010000:1.0:1788541072.985218:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541073.001717:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.002245:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945390848 00000100:00100000:2.0:1788541073.002256:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945390848 00000100:00100000:2.0:1788541073.002393:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 160 00000100:00100000:2.0:1788541073.002404:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+24:11467:x1875420945390848:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541073.002468:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541073.002491:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b562 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1836 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.002606:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.002622:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 25 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.002631:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.002665:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 25 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.002692:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 25 pid: 9724 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.002707:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968462080:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541073.002809:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6c00 going to sleep for 11 seconds 00000100:00080000:3.0:1788541073.004806:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541073.006634:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.007249:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945390976 00000100:00100000:2.0:1788541073.007260:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945390976 00010000:00010000:2.0:1788541073.007304:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 26 pid: 9724 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.007351:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:2.0:1788541073.007362:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:2359:x1875420945390976:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541073.007376:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541073.007383:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 26 pid: 9724 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.007397:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 26 pid: 9724 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.007445:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541073.007451:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.007461:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.007487:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.007507:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541073.007561:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:2359:x1875420945390976:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 201us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.007568:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00010000:00010000:1.0:1788541073.008870:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b54d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1828 expref: 25 pid: 9724 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541073.008892:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968462080:192.168.202.59@tcp:104: 00010000:00010000:1.0:1788541073.008917:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.008937:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.008956:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541073.008977:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788541073.009195:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b562 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.009212:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.009221:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:1.0:1788541073.009224:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788541073.009227:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603400, rc 0) 00000100:00100000:1.0:1788541073.009594:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+25:11467:x1875420945390848:12345-192.168.202.59@tcp:101:bash.0 Request processed in 7191us (7887us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788541073.009603:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 160 00000100:00100000:0.0:1788541073.014628:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.014770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945391232 00000100:00100000:3.0:1788541073.014780:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945391232 00000100:00100000:3.0:1788541073.014839:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 161 00000100:00100000:3.0:1788541073.014851:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+25:11467:x1875420945391232:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:3.0:1788541073.015138:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.015156:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.015169:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541073.015222:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788541073.015247:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004316cfd2 reply state 00000000f55634f6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.015255:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541073.015351:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:11467:x1875420945391232:12345-192.168.202.59@tcp:36:bash.0 Request processed in 502us (733us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788541073.015358:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 161 00000020:00080000:3.0:1788541073.015363:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788541073.021356:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.021374:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.021382:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.021389:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cce00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.021393:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.021401:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.021448:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541073.021452:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.021458:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.021465:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b577 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541073.026048:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.026624:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945391360 00000100:00100000:2.0:1788541073.026635:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945391360 00000100:00100000:2.0:1788541073.026699:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 162 00000100:00100000:2.0:1788541073.026711:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+27:11467:x1875420945391360:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541073.026735:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541073.026759:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b57e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac183d expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.026865:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.026881:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.026891:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.026937:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.026951:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 28 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.026968:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968462208:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541073.027049:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541073.029438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.029468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945391488 00000100:00100000:3.0:1788541073.029475:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945391488 00010000:00010000:3.0:1788541073.029527:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 29 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.029561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:3.0:1788541073.029570:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:2359:x1875420945391488:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541073.029595:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541073.029602:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 29 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029615:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 29 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029637:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541073.029643:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029653:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029661:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029679:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541073.029716:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:2359:x1875420945391488:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 147us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.029723:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00010000:00010000:3.0:1788541073.029773:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b569 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1836 expref: 28 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.029801:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968462208:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541073.029814:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029822:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029828:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541073.029870:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788541073.029874:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541073.029893:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029919:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b57e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac183d expref: 28 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029944:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac183d expref: 27 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.029952:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541073.029955:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541073.029957:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602200, rc 0) 00000100:00100000:3.0:1788541073.029980:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+27:11467:x1875420945391360:12345-192.168.202.59@tcp:101:bash.0 Request processed in 3272us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.029987:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 162 00000100:00100000:0.0:1788541073.033005:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.033331:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945391744 00000100:00100000:3.0:1788541073.033342:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945391744 00000100:00100000:3.0:1788541073.033471:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:3.0:1788541073.033483:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+27:11467:x1875420945391744:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:3.0:1788541073.033732:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:11467:x1875420945391744:12345-192.168.202.59@tcp:35:bash.0 Request processed in 251us (734us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788541073.033740:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:0.0:1788541073.092489:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.092747:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945392000 00000100:00100000:3.0:1788541073.092758:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945392000 00000100:00100000:3.0:1788541073.092812:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 163 00000100:00100000:3.0:1788541073.092819:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:11477:x1875420945392000:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541073.092840:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541073.092861:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b58c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1844 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541073.092955:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788541073.093083:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b58c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1844 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.093112:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:3.0:1788541073.093115:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541073.093121:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b58c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1844 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.093136:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4ccc00, rc 0) 00000100:00100000:3.0:1788541073.093246:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+29:11477:x1875420945392000:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 424us (768us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788541073.093266:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 163 00000100:00100000:0.0:1788541073.101224:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.103406:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945392128 00000100:00100000:3.0:1788541073.103481:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945392128 00000100:00100000:2.0:1788541073.103947:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 164 00000100:00100000:2.0:1788541073.103959:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:11477:x1875420945392128:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:2.0:1788541073.104057:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104075:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104096:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104115:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104121:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104128:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104476:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104486:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104493:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541073.104541:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104555:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104572:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104579:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104585:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.104589:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104596:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104608:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541073.104611:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.104616:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104622:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b59a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104635:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104642:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104647:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104652:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.104663:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104670:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104679:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553700) 00010000:00010000:2.0:1788541073.104682:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.104685:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104690:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104706:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104711:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104717:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104722:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.104725:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104730:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104737:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541073.104739:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.104748:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.104755:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.104846:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:11477:x1875420945392128:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 886us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.104854:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 164 00000100:00100000:0.0:1788541073.110222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.110777:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945392384 00000100:00100000:1.0:1788541073.110790:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945392384 00000100:00100000:1.0:1788541073.110852:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:1.0:1788541073.110865:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:11477:x1875420945392384:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:1.0:1788541073.111138:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+30:11477:x1875420945392384:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 275us (925us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788541073.111145:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1788541073.173780:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.173838:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945392640 00000100:00100000:3.0:1788541073.173848:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945392640 00000100:00100000:3.0:1788541073.174004:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 165 00000100:00100000:3.0:1788541073.174016:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+30:11480:x1875420945392640:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541073.174040:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541073.174063:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b5af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac184b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.174166:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.174182:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.174194:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.174210:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.174217:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.174224:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174671:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b5c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174682:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174690:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541073.174700:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788541073.174772:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174777:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174781:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174785:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541073.174788:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174793:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174801:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:0.0:1788541073.174803:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541073.174807:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174816:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b5b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174825:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174828:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174832:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174835:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cda00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541073.174836:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174840:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174844:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78320da00) 00010000:00010000:0.0:1788541073.174845:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541073.174846:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174849:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b5bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174880:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b5af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac184b expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174889:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac184b expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.174898:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:0.0:1788541073.174899:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541073.174901:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7600, rc 0) 00000100:00100000:0.0:1788541073.174984:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:11480:x1875420945392640:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 970us (1216us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788541073.174992:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 165 00000100:00100000:0.0:1788541073.179046:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.179463:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945392768 00000100:00100000:2.0:1788541073.179474:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945392768 00000100:00100000:2.0:1788541073.179546:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:2.0:1788541073.179556:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:11480:x1875420945392768:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1788541073.179635:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179653:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179664:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179695:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179701:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179708:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179714:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.179735:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179744:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179757:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541073.179760:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541073.179764:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.179771:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.179853:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:11480:x1875420945392768:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 296us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.179860:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 166 00000100:00100000:3.0:1788541073.182705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.182799:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945392896 00000100:00100000:2.0:1788541073.182808:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945392896 00000100:00100000:2.0:1788541073.182869:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:2.0:1788541073.182878:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+32:2359:x1875420945392896:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541073.182894:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541073.182918:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b5c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac184b expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.182948:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541073.182953:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541073.183022:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+31:2359:x1875420945392896:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 144us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.183039:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788541073.193651:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.193731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945393152 00000100:00100000:2.0:1788541073.193741:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945393152 00000100:00100000:2.0:1788541073.193796:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:2.0:1788541073.193805:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+31:11480:x1875420945393152:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541073.194067:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:11480:x1875420945393152:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 261us (425us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788541073.194074:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1788541073.341855:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.341984:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945393408 00000100:00100000:2.0:1788541073.341994:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945393408 00000100:00100000:2.0:1788541073.342248:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:2.0:1788541073.342260:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+32:11498:x1875420945393408:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1788541073.342287:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541073.342310:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1852 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.342434:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.342449:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.342459:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541073.342470:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788541073.342602:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1852 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.342644:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1852 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.342652:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:2.0:1788541073.342654:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788541073.342657:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603c00, rc 0) 00000100:00100000:2.0:1788541073.343219:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+34:11498:x1875420945393408:12345-192.168.202.59@tcp:101:cat.0 Request processed in 958us (1367us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788541073.343229:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:3.0:1788541073.363709:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.366307:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945393536 00000100:00100000:2.0:1788541073.366326:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945393536 00000100:00100000:2.0:1788541073.366484:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:2.0:1788541073.366495:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+34:11499:x1875420945393536:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541073.366517:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541073.366540:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1859 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.366619:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b5f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.366634:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.366647:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541073.366686:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788541073.366707:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541073.366730:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b5f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.366759:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b5ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1859 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.366779:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b5f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1859 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.366788:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541073.366791:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541073.366795:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602600, rc 0) 00000100:00100000:2.0:1788541073.366938:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+35:11499:x1875420945393536:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 444us (3238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.366945:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:2.0:1788541073.368912:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968462464:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369000:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.369055:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968462976:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369080:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.369121:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541073.369128:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968462592:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369150:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.369183:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968462720:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369222:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.369250:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788541073.369255:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968462336:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369299:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.369320:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968462848:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369342:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.369370:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968462464 00000100:00100000:2.0:1788541073.369378:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968462464 00000100:00100000:2.0:1788541073.369440:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968462592 00000100:00100000:2.0:1788541073.369444:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968462592 00000100:00100000:2.0:1788541073.369467:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968462848 00000100:00100000:2.0:1788541073.369470:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968462848 00000100:00100000:2.0:1788541073.369489:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788541073.369496:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968462464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369547:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968462464:12345-0@lo:400:kworker.0 Request processed in 51us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.369555:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788541073.369573:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788541073.369806:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968462592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369838:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968462592:12345-0@lo:400:kworker.0 Request processed in 36us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.369845:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788541073.369859:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788541073.369865:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968462848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369896:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968462848:12345-0@lo:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.369902:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788541073.369952:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968462592:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.369963:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968462464:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.370006:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968462848:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.370049:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968462976 00000100:00100000:2.0:1788541073.370054:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968462976 00000100:00100000:2.0:1788541073.370080:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968462720 00000100:00100000:2.0:1788541073.370083:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968462720 00000100:00100000:2.0:1788541073.370107:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788541073.370113:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968462976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.370149:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968462976:12345-0@lo:400:kworker.0 Request processed in 37us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.370155:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788541073.370167:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788541073.370172:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1875420968462720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.370908:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1875420968462720:12345-0@lo:400:kworker.0 Request processed in 733us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.370916:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788541073.370970:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968462720:0@lo:400:kworker.0 00000100:00100000:2.0:1788541073.371000:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968462976:0@lo:400:kworker.0 00000100:00100000:3.0:1788541073.371530:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968462336 00000100:00100000:3.0:1788541073.371537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968462336 00000100:00100000:3.0:1788541073.371574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788541073.371583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968462336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541073.371631:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968462336:12345-0@lo:400:kworker.0 Request processed in 49us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.371638:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:3.0:1788541073.371665:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541073.371670:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541073.371673:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541073.371695:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968462336:0@lo:400:kworker.0 00000100:00100000:3.0:1788541073.376268:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.376356:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945393920 00000100:00100000:2.0:1788541073.376365:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945393920 00000100:00100000:2.0:1788541073.376440:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1788541073.376448:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+35:11499:x1875420945393920:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541073.376808:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+36:11499:x1875420945393920:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 361us (550us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788541073.376814:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:0.0:1788541073.378543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.378829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394048 00000100:00100000:3.0:1788541073.378838:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394048 00000100:00100000:3.0:1788541073.378957:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1788541073.378968:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+36:11499:x1875420945394048:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:3.0:1788541073.378983:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788541073.379008:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac183d expref: 36 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.379030:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b5e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1852 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.379039:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17fe expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.379063:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553100) 00010000:00010000:3.0:1788541073.379072:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541073.379132:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c7a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+33:11499:x1875420945394048:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 165us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.379140:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1788541073.381103:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.381186:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394176 00000100:00100000:2.0:1788541073.381210:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394176 00000100:00100000:2.0:1788541073.381278:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 169 00000100:00100000:2.0:1788541073.381289:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+33:11499:x1875420945394176:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:2.0:1788541073.381462:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.381481:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.381495:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541073.381929:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788541073.382032:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+33:11499:x1875420945394176:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 743us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.382042:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 169 00000100:00100000:1.0:1788541073.408190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.408323:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394304 00000100:00100000:2.0:1788541073.408333:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394304 00000100:00100000:2.0:1788541073.408395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 170 00000100:00100000:2.0:1788541073.408405:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+33:11501:x1875420945394304:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541073.408462:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541073.408483:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b603 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1860 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408552:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408567:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408612:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408628:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408635:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408641:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408943:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.408951:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541073.408988:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788541073.408993:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541073.409012:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409024:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409033:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409050:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409057:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409063:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.409067:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409075:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409099:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541073.409102:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.409107:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409113:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b60a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.409127:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410706:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410715:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410721:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.410742:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410752:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410766:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553000) 00010000:00010000:2.0:1788541073.410769:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.410773:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410779:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410833:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b603 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410844:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.410849:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541073.410851:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541073.410852:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:2.0:1788541073.410978:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+34:11501:x1875420945394304:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 2574us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.410986:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 170 00000040:00080000:1.0:1788541073.559629:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541073.559640:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541073.560125:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788541073.560145:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541073.560271:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adee7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968463104:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541073.560371:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541073.571287:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.571325:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394432 00000100:00100000:1.0:1788541073.571335:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394432 00000100:00100000:1.0:1788541073.571394:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00100000:1.0:1788541073.571405:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945394432:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541073.571457:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541073.571562:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945394432:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 159us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.571570:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 171 00000100:00100000:1.0:1788541073.576948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.577017:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394560 00000100:00100000:3.0:1788541073.577027:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394560 00000100:00100000:3.0:1788541073.577125:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 172 00000100:00100000:2.0:1788541073.577282:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adee7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968463104:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788541073.577438:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+34:11512:x1875420945394560:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788541073.577509:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577528:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577540:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577594:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577602:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577608:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577636:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577651:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577658:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541073.577695:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788541073.577699:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541073.577714:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577725:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577730:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577737:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577742:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541073.577746:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577752:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577764:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:3.0:1788541073.577767:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541073.577771:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577788:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b61f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577798:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577804:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577809:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577813:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541073.577816:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577822:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577830:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff98d78320d100) 00010000:00010000:3.0:1788541073.577832:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541073.577835:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577841:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b626 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577855:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577861:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577873:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577878:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541073.577881:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577887:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577895:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:3.0:1788541073.577897:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541073.577899:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.577905:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b62d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.577989:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+34:11512:x1875420945394560:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 553us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.577997:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 172 00000100:00100000:1.0:1788541073.580626:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.580781:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394816 00000100:00100000:2.0:1788541073.580792:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394816 00000100:00100000:2.0:1788541073.580865:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 173 00000100:00100000:2.0:1788541073.580875:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+34:11512:x1875420945394816:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541073.580895:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541073.580915:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b634 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1867 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581024:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581039:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581050:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541073.581061:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788541073.581398:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581474:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581483:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581489:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.581494:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581503:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581525:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541073.581528:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541073.581532:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581538:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b63b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581650:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b634 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1867 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581661:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:2.0:1788541073.581664:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541073.581668:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b634 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1867 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.581678:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602c00, rc 0) 00000100:00100000:2.0:1788541073.581779:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945394816:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 905us (1161us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788541073.581787:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 173 00000100:00100000:2.0:1788541073.588095:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.588902:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945394944 00000100:00100000:1.0:1788541073.588915:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945394944 00000100:00100000:1.0:1788541073.589026:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 174 00000100:00100000:1.0:1788541073.589037:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945394944:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541073.589075:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541073.589391:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945394944:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 354us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.589399:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 174 00000100:00100000:1.0:1788541073.593651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.593881:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945395200 00000100:00100000:2.0:1788541073.593892:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945395200 00000100:00100000:1.0:1788541073.594361:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:1.0:1788541073.594373:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945395200:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541073.594403:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541073.594431:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788541073.594460:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b5f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1859 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.594480:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:1.0:1788541073.594487:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541073.594502:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac186e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541073.595296:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788541073.595576:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b650 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.595590:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.595602:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b650 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.595659:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac186e expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.595678:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b650 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac186e expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.595685:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d785548e00) 00010000:00010000:1.0:1788541073.595688:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541073.595698:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:1.0:1788541073.595771:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+36:11512:x1875420945395200:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1400us (2194us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788541073.595778:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 175 00000100:00100000:2.0:1788541073.607802:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.607898:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945395456 00000100:00100000:3.0:1788541073.607909:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945395456 00000100:00100000:3.0:1788541073.607979:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 176 00000100:00100000:3.0:1788541073.607990:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+36:11512:x1875420945395456:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541073.608054:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541073.608099:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac186e expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608137:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d785548e00) 00010000:00010000:3.0:1788541073.608148:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541073.608169:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608182:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608192:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608207:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608213:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608219:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608479:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608488:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608494:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608500:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541073.608504:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608518:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608529:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541073.608532:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541073.608536:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608541:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b65e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608551:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608557:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608562:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608567:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541073.608569:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608898:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608909:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdedddc5e (ffff98d78320d100) 00010000:00010000:3.0:1788541073.608912:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541073.608915:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.608960:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdedddc5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.609102:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945395456:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1112us (1308us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541073.609109:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 176 00000100:00100000:2.0:1788541073.617250:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.618678:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945395584 00000100:00100000:3.0:1788541073.618691:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945395584 00000100:00100000:3.0:1788541073.618759:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 177 00000100:00100000:3.0:1788541073.618771:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+35:11512:x1875420945395584:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541073.618792:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541073.618815:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b66c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1875 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.618852:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.618866:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.618878:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.618988:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b66c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.619006:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.619027:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:3.0:1788541073.619031:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541073.619034:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd800, rc 0) 00000100:00100000:3.0:1788541073.619543:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+36:11512:x1875420945395584:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 770us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.619551:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 177 00000100:00100000:3.0:1788541073.622236:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.622932:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945395840 00000100:00100000:2.0:1788541073.622945:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945395840 00000100:00100000:2.0:1788541073.623010:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 178 00000100:00100000:2.0:1788541073.623032:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+36:11512:x1875420945395840:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788541073.623129:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.623147:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.623159:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541073.623485:0:9724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788541073.623496:0:9724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358623086089ns, next at 359623083861ns, rc = 0 00000004:00010000:2.0:1788541073.623592:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a9e53ae reply state 000000002b89277e transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.623603:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541073.623700:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+38:11512:x1875420945395840:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 669us (1473us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788541073.623707:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 178 00000100:00100000:2.0:1788541073.632049:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541073.632152:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945395968 00000100:00100000:0.0:1788541073.632164:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945395968 00000100:00100000:0.0:1788541073.632241:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 179 00000100:00100000:0.0:1788541073.632254:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+38:11512:x1875420945395968:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541073.632287:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541073.632314:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac187c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.632383:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.632401:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.632454:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:0.0:1788541073.632458:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541073.632477:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7200, rc 0) 00000100:00100000:0.0:1788541073.632547:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+39:11512:x1875420945395968:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 294us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541073.632555:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 179 00010000:00010000:2.0:1788541073.632926:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.632937:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.632944:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.632950:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.632965:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.632973:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.632986:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:2.0:1788541073.632989:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788541073.632993:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.633000:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b67a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.637815:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541073.637880:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945396096 00000100:00100000:0.0:1788541073.637891:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945396096 00000100:00100000:0.0:1788541073.637973:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:0.0:1788541073.637985:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+6:2359:x1875420945396096:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788541073.638339:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945396096:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 354us (530us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788541073.638347:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00080000:2.0:1788541073.638538:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541073.642950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.643032:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945396352 00000100:00100000:3.0:1788541073.643042:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945396352 00000100:00100000:3.0:1788541073.643117:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1788541073.643129:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+38:11512:x1875420945396352:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788541073.643385:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+39:11512:x1875420945396352:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 258us (445us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788541073.643394:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:1.0:1788541073.658552:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541073.658698:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945396608 00000100:00100000:0.0:1788541073.658710:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945396608 00000100:00100000:0.0:1788541073.658768:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 180 00000100:00100000:0.0:1788541073.658778:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+39:11512:x1875420945396608:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788541073.663299:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+39:11512:x1875420945396608:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 4508us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541073.663316:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 180 00000100:00100000:3.0:1788541073.670524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541073.672114:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945396736 00000100:00100000:0.0:1788541073.672131:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945396736 00000100:00100000:0.0:1788541073.672206:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 181 00000100:00100000:0.0:1788541073.672218:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+39:11512:x1875420945396736:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541073.672240:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541073.672265:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1883 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.672361:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b68f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.672377:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.672388:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541073.672475:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541073.672499:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b68f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.672529:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1b688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1883 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.672548:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b68f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1883 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.672557:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:0.0:1788541073.672560:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788541073.672564:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7800, rc 0) 00000100:00100000:0.0:1788541073.672636:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+40:11512:x1875420945396736:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 421us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541073.672644:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 181 00000100:00100000:2.0:1788541073.682069:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.682183:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945396864 00000100:00100000:3.0:1788541073.682194:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945396864 00000100:00100000:3.0:1788541073.682268:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:3.0:1788541073.682279:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945396864:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541073.682299:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541073.682321:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac188a expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541073.682349:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af891, blocks: 0x1 00010000:00010000:3.0:1788541073.682382:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788541073.682388:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541073.682398:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.682443:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.682458:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cdc00, rc 0) 00000100:00100000:3.0:1788541073.682523:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945396864:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 245us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.682531:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:1.0:1788541073.685031:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.685178:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945397120 00000100:00100000:2.0:1788541073.685189:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945397120 00000100:00100000:2.0:1788541073.685248:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 182 00000100:00100000:2.0:1788541073.685257:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+40:11512:x1875420945397120:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541073.685370:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+40:11512:x1875420945397120:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 114us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.685378:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 182 00000100:00100000:1.0:1788541073.699588:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541073.699806:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945397248 00000100:00100000:0.0:1788541073.699816:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945397248 00000100:00100000:0.0:1788541073.699881:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:0.0:1788541073.699904:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:11512:x1875420945397248:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541073.699936:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541073.699958:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1891 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.699999:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.700009:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541073.700014:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541073.700020:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.700061:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.700077:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541073.700106:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968463232:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541073.700211:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bf694d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541073.707348:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968463232:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541073.707389:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.707464:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6200, rc 0) 00000100:00100000:0.0:1788541073.707519:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:11512:x1875420945397248:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 7616us (7946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541073.707528:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:3.0:1788541073.710960:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.711305:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945397376 00000100:00100000:2.0:1788541073.711316:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945397376 00010000:00010000:2.0:1788541073.711359:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.718457:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:2.0:1788541073.718501:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945397376:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541073.718525:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541073.718555:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.718573:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.718596:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac188a expref: 9 pid: 6706 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.718615:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541073.718619:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541073.718628:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.718639:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.718681:0:6720:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.718694:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6720:1875420968463360:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541073.718780:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541073.722557:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb477100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6720:1875420968463360:192.168.202.59@tcp:105: 00010000:00010000:3.0:1788541073.722599:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541073.722662:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945397376:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 4169us (11749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.722675:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:0.0:1788541073.731591:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.734964:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945397504 00000100:00100000:2.0:1788541073.734981:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945397504 00002000:00100000:2.0:1788541073.735049:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98d7b2f6ed80 x1875420945397504/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:444/0 lens 504/0 e 0 to 0 dl 1788541084 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541073.735061:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7b2f6ed80 with x1875420945397504 ext(0->8) 00002000:00010000:2.0:1788541073.735067:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7b2f6ed80 00000100:00100000:2.0:1788541073.735110:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1788541073.735120:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945397504:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788541073.735611:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:2359:x1875420945397504:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 489us (4030us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788541073.735620:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00002000:00100000:2.0:1788541073.735627:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff98d7b2f6ed80 x1875420945397504/t4294967314(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:444/0 lens 504/448 e 0 to 0 dl 1788541084 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541073.735636:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7b2f6ed80 with x1875420945397504 ext(0->8) 00002000:00010000:2.0:1788541073.735640:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7b2f6ed80 00000100:00100000:1.0:1788541073.738064:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541073.738189:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945397632 00000100:00100000:0.0:1788541073.738198:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945397632 00000100:00100000:0.0:1788541073.738256:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 183 00000100:00100000:0.0:1788541073.738267:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+40:11512:x1875420945397632:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788541073.802250:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+40:11512:x1875420945397632:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 63970us (64179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.802265:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 183 00000001:00080000:1.0:1788541073.802308:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:1.0:1788541073.802322:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:1.0:1788541073.802335:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788541073.802346:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1788541073.802350:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788541073.802381:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1788541073.802398:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788541073.802430:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788541073.802542:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968463488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541073.802612:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541073.802680:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968463488 00000100:00100000:1.0:1788541073.802687:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968463488 00000100:00100000:1.0:1788541073.802727:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788541073.802735:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968463488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788541073.802875:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788541073.802879:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788541073 00002000:00010000:1.0:1788541073.802882:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788541073.802896:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788541073 -> 1788541073 00002000:00010000:1.0:1788541073.802898:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788541073.802953:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875420968463488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (340us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788541073.802963:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1788541073.803005:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7bf5ca300/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788541073.803011:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968463488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788541073.805680:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.808547:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945397760 00000100:00100000:1.0:1788541073.808564:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945397760 00000100:00100000:0.0:1788541073.810448:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:0.0:1788541073.810461:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+10:2359:x1875420945397760:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788541073.884489:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968463616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541073.884561:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541073.884634:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968463616 00000100:00100000:2.0:1788541073.884641:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968463616 00000100:00100000:2.0:1788541073.884692:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788541073.884700:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875420968463616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541073.884723:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541073.884766:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1875420968463616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.884773:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788541073.884822:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968463616:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788541073.895966:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788541073.895985:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1788541073.895991:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1788541073.896194:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945397760:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 85730us (90518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541073.896207:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1788541073.903858:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.904384:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945398016 00000100:00100000:3.0:1788541073.904395:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945398016 00000100:00100000:3.0:1788541073.904492:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 184 00000100:00100000:3.0:1788541073.904503:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:11512:x1875420945398016:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541073.904555:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541073.904643:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b68f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1883 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.904678:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:3.0:1788541073.904684:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541073.904716:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.904730:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.904740:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541073.905022:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a34cb36 reply state 000000009e1192c1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.905031:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541073.905361:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:11512:x1875420945398016:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 860us (1512us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788541073.905369:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 184 00010000:00010000:1.0:1788541073.917959:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.917975:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.917982:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.917988:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541073.917993:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.918000:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.918018:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:1.0:1788541073.918021:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541073.918025:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.918043:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b6a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.918069:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.918490:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945398144 00000100:00100000:1.0:1788541073.918500:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945398144 00000100:00100000:1.0:1788541073.918551:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1788541073.918560:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945398144:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788541073.919016:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788541073.919021:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788541073 -> 1788541073 00002000:00010000:2.0:1788541073.919023:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788541071 00002000:00010000:2.0:1788541073.919025:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788541073 -> 1788541073 00002000:00010000:2.0:1788541073.919028:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788541073.919176:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945398144:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 615us (1109us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788541073.919185:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1788541073.921569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.921718:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945398400 00000100:00100000:3.0:1788541073.921729:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945398400 00000100:00100000:3.0:1788541073.921823:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 185 00000100:00100000:3.0:1788541073.921835:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+18:11512:x1875420945398400:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788541073.921905:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.921935:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.921963:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.921998:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.922314:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 18 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.922332:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968463744:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541073.922522:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541073.926021:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.926488:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945398528 00000100:00100000:1.0:1788541073.926498:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945398528 00010000:00010000:1.0:1788541073.926540:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 19 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541073.926594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:1.0:1788541073.926604:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+19:2359:x1875420945398528:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541073.926619:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541073.926626:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 19 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.926638:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 19 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.926659:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:1.0:1788541073.926665:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.926675:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.926696:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.926715:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541073.926771:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+19:2359:x1875420945398528:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 168us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.926779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00010000:00010000:3.0:1788541073.928101:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1875 expref: 18 pid: 5850 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.928133:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf57800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968463744:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541073.928159:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928169:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928174:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928205:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928211:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928231:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928248:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541073.928253:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928261:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928276:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:3.0:1788541073.928279:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788541073.928283:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.928290:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b6ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.928364:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681bab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+17:11512:x1875420945398400:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 6530us (6803us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788541073.928374:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 185 00000100:00100000:2.0:1788541073.931442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.931553:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945398656 00000100:00100000:1.0:1788541073.931565:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945398656 00000100:00100000:1.0:1788541073.931631:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:1.0:1788541073.931642:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945398656:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788541073.931689:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.931711:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.931721:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541073.931725:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541073.931730:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.931767:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.931782:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541073.931806:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681ba9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968463872:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541073.931890:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541073.935302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.935625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945398784 00000100:00100000:1.0:1788541073.935637:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945398784 00010000:00010000:1.0:1788541073.935679:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 9 pid: 6704 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541073.935718:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:1.0:1788541073.935728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945398784:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541073.935745:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541073.935768:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 9 pid: 6704 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.935782:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 9 pid: 6704 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.935807:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541073.935812:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541073.935818:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.935828:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.935850:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541073.935930:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945398784:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 202us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.935938:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00010000:00010000:2.0:1788541073.937853:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1b69d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1891 expref: 8 pid: 6704 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.937876:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681ba9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875420968463872:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541073.937902:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.937928:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.937935:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.937992:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.938001:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.938010:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.938017:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541073.938021:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.938031:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.938050:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.938059:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084f20a87/0xc9a6a13d3cd1b6b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.938260:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945398656:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 6617us (6859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.938270:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:3.0:1788541073.941146:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541073.941321:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945399040 00000100:00100000:1.0:1788541073.941331:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945399040 00000100:00100000:1.0:1788541073.941490:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 186 00000100:00100000:1.0:1788541073.941501:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+17:11512:x1875420945399040:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788541073.941793:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.941812:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.941824:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.942053:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.942077:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.942096:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.942131:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.942146:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 18 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541073.942160:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968464000:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541073.942250:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541073.945712:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541073.945805:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945399168 00000100:00100000:2.0:1788541073.945816:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945399168 00010000:00010000:2.0:1788541073.945858:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 19 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.945903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:2.0:1788541073.945923:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+19:2359:x1875420945399168:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541073.945941:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541073.945948:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 19 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.945963:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 19 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.945986:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:2.0:1788541073.945992:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.946001:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.946009:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.946028:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541073.946092:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+19:2359:x1875420945399168:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 179us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.946100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00010000:00010000:0.0:1788541073.946668:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac187c expref: 18 pid: 5852 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541073.946685:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968464000:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541073.946707:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.946717:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541073.946723:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541073.946908:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788541073.947103:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788541073.947148:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788541073.947351:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968464128:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541073.951302:0:9724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541073.951376:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d790c61e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541073.951567:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968464128 00000100:00100000:2.0:1788541073.951590:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968464128 00000100:00100000:2.0:1788541073.951650:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541073.951660:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9724:x1875420968464128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541073.951768:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9724:x1875420968464128:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541073.951775:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541073.952011:0:9724:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788541073.952019:0:9724:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7bf5ca300, transno 4294967315 00000100:00100000:1.0:1788541073.952043:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968464128:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788541073.952616:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788541073.952700:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681ba9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968464256:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788541073.952747:0:9724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541073.952767:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541073.953288:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968464256 00000100:00100000:2.0:1788541073.953296:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968464256 00000100:00100000:2.0:1788541073.953329:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541073.953336:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9724:x1875420968464256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541073.953536:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9724:x1875420968464256:12345-0@lo:1000:mdt00_003.0 Request processed in 200us (787us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788541073.953543:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541073.953854:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681ba9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968464256:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788541073.953895:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.953905:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.953912:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.953931:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541073.953936:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.953958:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.953975:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320d900) 00010000:00010000:1.0:1788541073.953978:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541073.953982:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.953987:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7e00/0xc9a6a13d3cd1b6c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954020:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954026:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954031:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954036:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541073.954039:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954045:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954053:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:1.0:1788541073.954055:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541073.954058:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954086:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b5fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954116:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954130:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954139:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954169:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541073.954184:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 21 pid: 5851 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541073.954198:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968464384:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541073.954565:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541073.958286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.958482:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945399296 00000100:00100000:3.0:1788541073.958492:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945399296 00010000:00010000:3.0:1788541073.958534:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 22 pid: 5851 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.958779:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681ba8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968464384:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541073.958803:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541073.958849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:3.0:1788541073.958873:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681bab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+22:2359:x1875420945399296:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541073.958887:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541073.958894:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 22 pid: 5851 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.958906:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 22 pid: 5851 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.958940:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1860 expref: 22 pid: 5851 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.958955:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:3.0:1788541073.958959:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.958969:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.958978:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.959005:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541073.959064:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681bab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:2359:x1875420945399296:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 193us (786us total) trans 0 rc 0/0 00010000:00010000:2.0:1788541073.959496:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959505:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959517:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959523:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959530:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959546:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.959551:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959558:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959567:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541073.959570:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541073.959585:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959592:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031e00/0xc9a6a13d3cd1b6c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959605:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959611:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959616:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959621:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541073.959624:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959630:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959648:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553700) 00010000:00010000:2.0:1788541073.959651:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541073.959654:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.959660:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b6b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541073.959891:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+21:11512:x1875420945399040:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 18390us (18815us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788541073.959900:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 186 00000020:00080000:2.0:1788541073.959904:0:9724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788541073.960143:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541073.960147:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541073.960684:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788541073.960694:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788541073.962746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:1.0:1788541073.965148:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541073.965266:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945399552 00000100:00100000:3.0:1788541073.965279:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945399552 00000100:00100000:3.0:1788541073.965352:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1788541073.965363:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:11512:x1875420945399552:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788541073.966509:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788541073.968035:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788541073.968128:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.968145:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.968157:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.968166:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.968173:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.968179:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541073.968204:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541073.968563:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+22:11512:x1875420945399552:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 3198us (3421us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788541073.968574:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000020:00080000:3.0:1788541073.968580:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788541073.968959:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541073.968967:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.968974:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541073.968978:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.968987:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.969000:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff98d78320dc00) 00010000:00010000:2.0:1788541073.969004:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788541073.969010:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.969016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b6ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541073.969058:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541073.969060:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541073.969061:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541074.007884:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541074.112063:0:12525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541074.112075:0:12525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541074.115271:0:12525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788541074.115282:0:12525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541074.220075:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.220144:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945399808 00000100:00100000:2.0:1788541074.220154:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945399808 00000100:00100000:2.0:1788541074.220211:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 187 00000100:00100000:2.0:1788541074.220221:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+22:11522:x1875420945399808:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541074.220258:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541074.220279:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1898 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.220377:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b6dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.220394:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.220405:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541074.220433:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788541074.220560:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1898 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.220602:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b6dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1898 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.220611:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541074.220614:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541074.220619:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603800, rc 0) 00000100:00100000:2.0:1788541074.220677:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+24:11522:x1875420945399808:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 457us (612us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788541074.220685:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 187 00000100:00100000:2.0:1788541074.225189:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541074.226565:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945399936 00000100:00100000:0.0:1788541074.226579:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945399936 00000100:00100000:0.0:1788541074.226651:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 188 00000100:00100000:0.0:1788541074.226662:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+24:11522:x1875420945399936:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1788541074.226733:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.226747:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.226756:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.226766:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.226771:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.226775:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.226995:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227003:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227018:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541074.227056:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227551:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227559:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227567:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227573:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.227578:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227585:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227599:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:0.0:1788541074.227602:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541074.227606:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227612:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b6ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227625:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227640:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227645:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227650:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.227653:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227658:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227667:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78b22b000) 00010000:00010000:0.0:1788541074.227669:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541074.227672:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227678:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b6f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227695:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227701:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227706:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227711:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.227722:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227728:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227736:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78b22bf00) 00010000:00010000:0.0:1788541074.227738:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541074.227741:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.227747:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6600/0xc9a6a13d3cd1b6f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.227822:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+24:11522:x1875420945399936:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1160us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.227829:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 188 00000100:00100000:2.0:1788541074.288569:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.288662:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945400192 00000100:00100000:3.0:1788541074.288672:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945400192 00000100:00100000:3.0:1788541074.288736:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:3.0:1788541074.288746:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+24:11525:x1875420945400192:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541074.288767:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.288794:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b6ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac189f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.288869:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.288884:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.288900:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.288928:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.288936:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.288942:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289535:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289546:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289554:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541074.289564:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788541074.289665:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289680:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289688:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289693:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.289698:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289706:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289719:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541074.289722:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541074.289727:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289734:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b706 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289745:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289751:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289757:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289762:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.289770:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289776:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289783:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78320da00) 00010000:00010000:3.0:1788541074.289785:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541074.289788:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289793:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b70d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289831:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b6ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289845:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.289852:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:3.0:1788541074.289855:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541074.289857:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc400, rc 0) 00000100:00100000:3.0:1788541074.289934:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+26:11525:x1875420945400192:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1189us (1372us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788541074.289942:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 189 00000100:00100000:2.0:1788541074.294372:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.294491:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945400320 00000100:00100000:3.0:1788541074.294501:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945400320 00000100:00100000:3.0:1788541074.294655:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00100000:3.0:1788541074.294667:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:11525:x1875420945400320:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:3.0:1788541074.294738:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294754:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294766:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294792:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294798:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294805:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294811:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.294816:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294824:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294835:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:3.0:1788541074.294838:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541074.294842:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.294848:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541074.294946:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:11525:x1875420945400320:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 281us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.294954:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 190 00000100:00100000:2.0:1788541074.297928:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541074.299192:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945400576 00000100:00100000:0.0:1788541074.299205:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945400576 00000100:00100000:0.0:1788541074.299277:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1788541074.299288:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+26:11525:x1875420945400576:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541074.300067:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+27:11525:x1875420945400576:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 778us (2155us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788541074.300086:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:0.0:1788541074.328193:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.330387:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945400832 00000100:00100000:3.0:1788541074.330403:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945400832 00000100:00100000:3.0:1788541074.330479:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 191 00000100:00100000:3.0:1788541074.330491:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+27:11060:x1875420945400832:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541074.330516:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.330538:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b729 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18a6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.330808:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.330825:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.330835:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.330869:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.330883:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 28 pid: 5852 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541074.330898:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968464512:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541074.331761:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541074.340042:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968464512:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541074.340090:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.343599:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.343638:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945400960 00000100:00100000:2.0:1788541074.343648:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945400960 00010000:00010000:2.0:1788541074.343690:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 29 pid: 5852 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.343727:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:2.0:1788541074.343738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+29:2359:x1875420945400960:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541074.343763:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541074.343771:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 29 pid: 5852 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343785:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 29 pid: 5852 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343806:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1b714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac189f expref: 29 pid: 5852 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343819:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:2.0:1788541074.343824:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343833:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343840:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343863:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541074.343925:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+28:2359:x1875420945400960:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 176us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.343932:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 74 00010000:00010000:2.0:1788541074.343960:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.343967:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541074.343997:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788541074.344327:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd200/0xc9a6a13d3cd1b729 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.344343:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.344350:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:2.0:1788541074.344353:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541074.344355:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd800, rc 0) 00000100:00100000:2.0:1788541074.344381:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+28:11060:x1875420945400832:12345-192.168.202.59@tcp:101:bash.0 Request processed in 13893us (16200us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788541074.344387:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 191 00000100:00100000:2.0:1788541074.350442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.350484:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945401216 00000100:00100000:2.0:1788541074.350494:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945401216 00000100:00100000:2.0:1788541074.350553:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 192 00000100:00100000:2.0:1788541074.350564:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:11060:x1875420945401216:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1788541074.350850:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.350868:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.350881:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541074.350954:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788541074.350996:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000341515c3 reply state 0000000011d64b22 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.351006:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788541074.351062:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788541074.351168:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:11060:x1875420945401216:12345-192.168.202.59@tcp:36:bash.0 Request processed in 603us (756us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788541074.351175:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 192 00000020:00080000:2.0:1788541074.351180:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788541074.353814:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.353832:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.353839:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.353844:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.353849:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.353857:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.353875:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:2.0:1788541074.353878:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.353883:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.353888:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b73e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.355398:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.361527:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945401344 00000100:00100000:3.0:1788541074.361546:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945401344 00000100:00100000:3.0:1788541074.362702:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 193 00000100:00100000:3.0:1788541074.362720:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+31:11060:x1875420945401344:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541074.362747:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.362771:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18ad expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.362837:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ad expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.362852:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ad expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.362870:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:3.0:1788541074.362873:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541074.362878:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc000, rc 0) 00000100:00100000:3.0:1788541074.363166:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+32:11060:x1875420945401344:12345-192.168.202.59@tcp:101:bash.0 Request processed in 451us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.363174:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 193 00000100:00100000:0.0:1788541074.376015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541074.380544:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945401472 00000100:00100000:1.0:1788541074.380561:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945401472 00000100:00100000:0.0:1788541074.382973:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:0.0:1788541074.382989:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:11060:x1875420945401472:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541074.383027:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541074.383050:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18b4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541074.383089:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9af891, atime: 0x6a9af88f, ctime: 0x6a9af891, blocks: 0xb 00010000:00010000:0.0:1788541074.383115:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1788541074.383120:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541074.383129:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.383147:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.383162:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6600, rc 0) 00000100:00100000:0.0:1788541074.383227:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:11060:x1875420945401472:12345-192.168.202.59@tcp:101:bash.0 Request processed in 241us (7222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.383234:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:3.0:1788541074.386389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541074.386561:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945401600 00000100:00100000:1.0:1788541074.386580:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945401600 00002000:00010000:1.0:1788541074.386625:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788541074.386631:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7adf56680 with x1875420945401600 ext(0->18446744073709551615) 00002000:00010000:1.0:1788541074.386642:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7adf56680. 00000100:00100000:1.0:1788541074.386669:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1788541074.386679:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945401600:12345-192.168.202.59@tcp:10:bash.0 00002000:00010000:1.0:1788541074.386975:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788541074.386979:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788541073 -> 1788541074 00002000:00010000:1.0:1788541074.386982:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788541071 -> 1788541071 00002000:00010000:1.0:1788541074.386985:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788541073 -> 1788541074 00002000:00010000:1.0:1788541074.386987:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788541074.387275:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945401600:12345-192.168.202.59@tcp:10:bash.0 Request processed in 596us (893us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788541074.387284:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00002000:00010000:1.0:1788541074.387288:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788541074.387290:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7adf56680 with x1875420945401600 ext(0->18446744073709551615) 00002000:00010000:1.0:1788541074.387296:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7adf56680. 00000100:00100000:2.0:1788541074.464982:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541074.465108:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945401728 00000100:00100000:0.0:1788541074.465120:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945401728 00000100:00100000:0.0:1788541074.465185:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:0.0:1788541074.465196:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:11539:x1875420945401728:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1788541074.465293:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465310:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465342:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465360:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465368:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465374:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465961:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465973:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.465980:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541074.466019:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466029:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466035:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466041:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466057:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.466062:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466070:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466139:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:0.0:1788541074.466142:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541074.466147:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466154:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7200/0xc9a6a13d3cd1b753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466168:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466174:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466180:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466185:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.466187:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466193:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466211:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78b22b900) 00010000:00010000:0.0:1788541074.466214:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541074.466217:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466223:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b75a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466291:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466297:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466302:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466306:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.466309:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466316:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466324:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:0.0:1788541074.466326:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541074.466330:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.466335:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.466527:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+32:11539:x1875420945401728:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1330us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.466537:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 194 00000100:00100000:0.0:1788541074.504301:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.504399:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945401984 00000100:00100000:2.0:1788541074.504450:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945401984 00000100:00100000:2.0:1788541074.504522:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 195 00000100:00100000:2.0:1788541074.504534:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+32:11542:x1875420945401984:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541074.504557:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541074.504590:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18bb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.504692:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.504709:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.504720:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.504737:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.504745:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.504752:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505024:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b77d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505041:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b77d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505048:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b77d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541074.505059:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788541074.505159:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505167:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505174:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505180:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.505184:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505192:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505206:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541074.505209:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.505213:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505220:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b76f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505232:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505247:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505253:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505258:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.505261:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505267:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505275:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553700) 00010000:00010000:2.0:1788541074.505278:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.505281:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505286:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b776 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505328:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18bb expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505342:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b77d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18bb expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.505349:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:2.0:1788541074.505351:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788541074.505360:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603400, rc 0) 00000100:00100000:2.0:1788541074.505753:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+34:11542:x1875420945401984:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1219us (1460us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788541074.505763:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 195 00000100:00100000:2.0:1788541074.509787:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.509876:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945402112 00000100:00100000:3.0:1788541074.509887:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945402112 00000100:00100000:3.0:1788541074.510016:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:3.0:1788541074.510028:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+34:11542:x1875420945402112:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:3.0:1788541074.510109:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.510140:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.510149:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.510188:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.510203:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 34 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541074.510216:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf680380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968464640:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541074.510509:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541074.514144:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541074.514335:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945402368 00000100:00100000:0.0:1788541074.514345:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945402368 00000100:00100000:0.0:1788541074.514443:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:0.0:1788541074.514454:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:9232:x1875420945402368:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788541074.514844:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+36:9232:x1875420945402368:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 391us (708us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788541074.514853:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:3.0:1788541074.517629:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf680380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968464640:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541074.517679:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.517809:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541074.518066:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945402496 00000100:00100000:0.0:1788541074.518142:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945402496 00010000:00010000:0.0:1788541074.518180:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 36 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.518217:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 75 00000100:00100000:0.0:1788541074.518228:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+36:2358:x1875420945402496:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541074.518253:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541074.518260:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 36 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.518273:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 36 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.518316:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1b730 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18a6 expref: 36 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.518333:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:0.0:1788541074.518338:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.518347:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.518355:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.518385:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541074.518475:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+35:2358:x1875420945402496:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 248us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.518482:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 75 00010000:00010000:3.0:1788541074.518812:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518820:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518852:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518860:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518874:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518880:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.518885:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518892:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518902:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:3.0:1788541074.518904:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541074.518920:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.518927:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b78b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541074.518968:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+34:11542:x1875420945402112:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 8942us (9193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.518975:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 196 00000100:00100000:0.0:1788541074.522049:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.522184:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945402752 00000100:00100000:3.0:1788541074.522195:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945402752 00000100:00100000:3.0:1788541074.522356:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:3.0:1788541074.522367:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+34:11542:x1875420945402752:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541074.522825:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+35:11542:x1875420945402752:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 457us (783us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788541074.522833:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:0.0:1788541074.615725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.615892:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945403008 00000100:00100000:3.0:1788541074.615903:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945403008 00000100:00100000:3.0:1788541074.615982:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 197 00000100:00100000:3.0:1788541074.615993:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+35:11553:x1875420945403008:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:3.0:1788541074.616016:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.616037:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18c2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616115:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616131:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616143:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616157:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616164:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616170:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616494:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b7a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616504:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616524:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541074.616537:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788541074.616634:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616642:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616650:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616656:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.616661:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616669:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616680:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541074.616683:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541074.616688:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616694:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616704:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616710:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616721:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616726:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cdc00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.616729:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616735:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616742:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78320da00) 00010000:00010000:3.0:1788541074.616744:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541074.616746:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616752:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b7a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616789:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd400/0xc9a6a13d3cd1b792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c2 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616801:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c2 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.616808:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:3.0:1788541074.616810:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541074.616812:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4ccc00, rc 0) 00000100:00100000:3.0:1788541074.616862:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+37:11553:x1875420945403008:12345-192.168.202.59@tcp:101:cat.0 Request processed in 871us (1149us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788541074.616877:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 197 00000100:00100000:2.0:1788541074.623729:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541074.623833:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945403264 00000100:00100000:1.0:1788541074.623843:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945403264 00000100:00100000:1.0:1788541074.623902:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:1.0:1788541074.623923:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+37:11553:x1875420945403264:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:1.0:1788541074.624186:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+38:11553:x1875420945403264:12345-192.168.202.59@tcp:35:cat.0 Request processed in 273us (466us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788541074.624319:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:0.0:1788541074.653475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.660707:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945403520 00000100:00100000:2.0:1788541074.660724:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945403520 00000100:00100000:2.0:1788541074.660839:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 198 00000100:00100000:2.0:1788541074.660847:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+38:11554:x1875420945403520:12345-192.168.202.59@tcp:36:rm.0 00010000:00010000:2.0:1788541074.660904:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788541074.660944:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1b7a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c2 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.660967:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b77d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18bb expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.660976:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc000/0xc9a6a13d3cd1b745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ad expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.660984:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d78320d400) 00010000:00010000:2.0:1788541074.660992:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541074.661010:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661020:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661039:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661049:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661053:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661057:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661293:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661301:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661308:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541074.661840:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788541074.661847:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359661437532ns, next at 360661436119ns, rc = 0 00010000:00010000:2.0:1788541074.661899:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661920:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661928:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661947:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661954:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661958:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.661977:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541074.661994:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662000:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662006:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662009:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541074.662012:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541074.662015:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662017:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662022:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541074.662025:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662025:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662031:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662036:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553500) 00010000:00010000:2.0:1788541074.662038:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788541074.662042:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662046:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff98d786553500) 00010000:00010000:0.0:1788541074.662048:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788541074.662051:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662056:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662056:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b7ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662070:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541074.662072:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662077:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662081:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541074.662083:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.662083:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541074.662088:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.662091:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662097:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662105:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541074.662107:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.662111:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.662115:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541074.662124:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4367424 reply state 00000000a719be04 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.662132:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541074.662213:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+37:11554:x1875420945403520:12345-192.168.202.59@tcp:36:rm.0 Request processed in 1363us (8831us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788541074.662222:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 198 00010000:00010000:1.0:1788541074.666813:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.666846:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.666855:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.666861:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541074.666866:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.666874:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.666899:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553700) 00010000:00010000:1.0:1788541074.666903:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541074.666936:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.666943:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b7bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.712055:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.712146:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945403776 00000100:00100000:2.0:1788541074.712156:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945403776 00000100:00100000:2.0:1788541074.712223:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 199 00000100:00100000:2.0:1788541074.712234:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+36:11560:x1875420945403776:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541074.712258:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541074.712279:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18c9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.712388:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.712400:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.712445:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.712462:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.712469:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.712476:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541074.712935:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788541074.713097:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713114:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713122:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713157:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713164:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713170:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713175:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.713179:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713187:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713199:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541074.713201:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.713205:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713211:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b7d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541074.713223:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043e63869 reply state 00000000938c211c transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.713239:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788541074.713269:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b7d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713283:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.713290:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:2.0:1788541074.713292:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541074.713294:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603c00, rc 0) 00000100:00100000:2.0:1788541074.713361:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+39:11560:x1875420945403776:12345-192.168.202.59@tcp:101:bash.0 Request processed in 1130us (1314us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788541074.713368:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 199 00000100:00100000:0.0:1788541074.717109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.717255:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945403904 00000100:00100000:3.0:1788541074.717265:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945403904 00000100:00100000:3.0:1788541074.717344:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:3.0:1788541074.717356:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945403904:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541074.717373:0:9248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.717434:0:9248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18d0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541074.717465:0:9248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788541074.717484:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788541074.717488:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541074.717498:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 8 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.717516:0:9248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 8 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.717529:0:9248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd400, rc 0) 00000100:00100000:3.0:1788541074.717589:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2360:x1875420945403904:12345-192.168.202.59@tcp:101:bash.0 Request processed in 236us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.717597:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00080000:0.0:1788541074.717934:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788541074.718691:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.718704:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.718711:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.718716:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.718721:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.718729:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.719023:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553000) 00010000:00010000:2.0:1788541074.719026:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.719031:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.719037:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b7df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.720063:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.732001:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945404032 00000100:00100000:2.0:1788541074.732020:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945404032 00000100:00100000:2.0:1788541074.732097:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:2.0:1788541074.732109:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:11560:x1875420945404032:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541074.732139:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541074.732158:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18d7 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.732472:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.732483:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541074.732488:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541074.732494:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.732532:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.732565:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.732580:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875420968464768:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541074.732683:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541074.739708:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875420968464768:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541074.739748:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.739772:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603600, rc 0) 00000100:00100000:2.0:1788541074.739838:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+9:11560:x1875420945404032:12345-192.168.202.59@tcp:101:bash.0 Request processed in 7731us (19780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.739847:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1788541074.740479:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.740713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945404160 00000100:00100000:2.0:1788541074.740721:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945404160 00010000:00010000:2.0:1788541074.740755:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.740793:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:2.0:1788541074.740803:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945404160:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541074.740815:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541074.740837:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.740869:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.741025:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009db42df0/0xc9a6a13d3cd1b7f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d0 expref: 9 pid: 9248 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.741039:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541074.741043:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541074.741052:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.741061:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.741097:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.741110:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875420968464896:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541074.741358:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541074.750024:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875420968464896:192.168.202.59@tcp:105: 00010000:00010000:2.0:1788541074.750060:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541074.750134:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945404160:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 9331us (9655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.750144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:3.0:1788541074.751487:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541074.751625:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945404416 00000100:00100000:1.0:1788541074.751635:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945404416 00000100:00100000:1.0:1788541074.751690:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:1.0:1788541074.751700:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+38:11560:x1875420945404416:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:1.0:1788541074.752038:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+39:11560:x1875420945404416:12345-192.168.202.59@tcp:35:bash.0 Request processed in 338us (557us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788541074.752045:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:1.0:1788541074.879511:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.879655:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945404544 00000100:00100000:3.0:1788541074.879665:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945404544 00000100:00100000:3.0:1788541074.879731:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:3.0:1788541074.879753:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+39:11576:x1875420945404544:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541074.879778:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.879798:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18de expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.879862:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.879887:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.879899:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541074.879945:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788541074.879949:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541074.879967:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.879993:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18de expref: 41 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.880012:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18de expref: 40 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.880021:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541074.880023:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541074.880027:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd600, rc 0) 00000100:00100000:3.0:1788541074.880103:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+40:11576:x1875420945404544:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 352us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.880119:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 200 00000100:00100000:0.0:1788541074.888365:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.888438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945404800 00000100:00100000:3.0:1788541074.888447:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945404800 00000100:00100000:3.0:1788541074.888496:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 201 00000100:00100000:3.0:1788541074.888504:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+40:11576:x1875420945404800:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541074.888522:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541074.888539:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18e5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.888641:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.888654:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.888663:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541074.888671:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788541074.888780:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1b810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18e5 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.888793:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18e5 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.888799:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:3.0:1788541074.888801:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541074.888804:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cda00, rc 0) 00000100:00100000:3.0:1788541074.888865:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+42:11576:x1875420945404800:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 360us (508us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788541074.888872:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 201 00000100:00100000:0.0:1788541074.893502:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.893775:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405056 00000100:00100000:2.0:1788541074.893785:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405056 00000100:00100000:2.0:1788541074.893841:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:2.0:1788541074.893851:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+42:11576:x1875420945405056:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541074.893878:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541074.893903:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b825 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.894019:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b82c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.894036:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.894048:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541074.894061:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788541074.894287:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b825 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ec expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.894308:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ec expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.894317:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:2.0:1788541074.894320:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788541074.894323:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602200, rc 0) 00000100:00100000:2.0:1788541074.894390:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad254e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+44:11576:x1875420945405056:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 539us (897us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788541074.894444:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 202 00000100:00100000:0.0:1788541074.896761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.896843:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405184 00000100:00100000:3.0:1788541074.896852:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405184 00000100:00100000:3.0:1788541074.896956:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1788541074.896968:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+44:2359:x1875420945405184:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541074.896984:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541074.897006:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18e5 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.897024:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:3.0:1788541074.897029:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541074.897110:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+43:2359:x1875420945405184:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 143us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.897118:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:0.0:1788541074.902782:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.904991:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405312 00000100:00100000:3.0:1788541074.905007:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405312 00000100:00100000:3.0:1788541074.905087:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:3.0:1788541074.905098:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2360:x1875420945405312:12345-192.168.202.59@tcp:1:lfs.0 00010000:00010000:3.0:1788541074.905150:0:9248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.905174:0:9248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.905180:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541074.905199:0:9248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541074.905202:0:9248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.905232:0:9248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.905246:0:9248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 8 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541074.905260:0:9248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968465024:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541074.905361:0:9248:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541074.909027:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.909044:0:9248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9248:1875420968465024:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541074.909072:0:9248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.909129:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405440 00000100:00100000:2.0:1788541074.909136:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405440 00002000:00100000:2.0:1788541074.909182:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98d68130bb80 x1875420945405440/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:445/0 lens 504/0 e 0 to 0 dl 1788541085 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541074.909314:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d68130bb80 with x1875420945405440 ext(0->8) 00010000:00010000:2.0:1788541074.909322:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 9 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.909337:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 9 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541074.909344:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d68130bb80 00000100:00100000:2.0:1788541074.909376:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1788541074.909386:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+9:2359:x1875420945405440:12345-192.168.202.59@tcp:4:lfs.0 00000100:00100000:2.0:1788541074.909829:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+11:2359:x1875420945405440:12345-192.168.202.59@tcp:4:lfs.0 Request processed in 443us (811us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788541074.909834:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00002000:00100000:2.0:1788541074.909839:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff98d68130bb80 x1875420945405440/t4294967308(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:445/0 lens 504/448 e 0 to 0 dl 1788541085 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541074.909845:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d68130bb80 with x1875420945405440 ext(0->8) 00010000:00010000:2.0:1788541074.909849:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 11 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.909864:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 11 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541074.909869:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff98d68130bb80 00000100:00100000:0.0:1788541074.911955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.912275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405568 00000100:00100000:3.0:1788541074.912285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405568 00010000:00010000:3.0:1788541074.912326:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 11 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541074.912395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:3.0:1788541074.912403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+11:2361:x1875420945405568:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541074.912440:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788541074.912456:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788541074.912458:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788541074 00002000:00010000:3.0:1788541074.912470:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788541074 00002000:00010000:3.0:1788541074.912472:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788541074 00010000:00010000:3.0:1788541074.912477:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 11 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.912488:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 11 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.912506:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d84f205c/0xc9a6a13d3cd1b7fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18d7 expref: 11 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.912520:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541074.912523:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541074.912528:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.912534:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.912556:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541074.912615:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:2361:x1875420945405568:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 212us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541074.912623:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00010000:00010000:0.0:1788541074.912798:0:9248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912807:0:9248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912832:0:9248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912847:0:9248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912855:0:9248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912862:0:9248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cdc00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541074.912866:0:9248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912875:0:9248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912888:0:9248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.912895:0:9248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011dbc5fd/0xc9a6a13d3cd1b83a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.912965:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+9:2360:x1875420945405312:12345-192.168.202.59@tcp:1:lfs.0 Request processed in 7869us (10194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.912974:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:0.0:1788541074.914758:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541074.914822:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405824 00000100:00100000:1.0:1788541074.914829:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405824 00000100:00100000:1.0:1788541074.914872:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1788541074.914882:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+43:11576:x1875420945405824:12345-192.168.202.59@tcp:35:lfs.0 00000004:00010000:1.0:1788541074.914952:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ec expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541074.915384:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788541074.915503:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788541074.915747:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788541074.915786:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.915798:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.915804:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.915829:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541074.915839:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 47 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541074.915849:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681babb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875420968465152:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541074.915932:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059600 going to sleep for 11 seconds 00000100:00100000:1.0:1788541074.917946:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.918026:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945405952 00000100:00100000:2.0:1788541074.918033:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945405952 00010000:00010000:2.0:1788541074.918067:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 48 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.918103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:2.0:1788541074.918113:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+48:2358:x1875420945405952:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541074.918136:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541074.918141:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 48 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.918151:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 48 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.918173:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:2.0:1788541074.918176:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.918183:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.918192:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.918214:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541074.918270:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+48:2358:x1875420945405952:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.918278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00010000:00010000:0.0:1788541074.918848:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b7e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18c9 expref: 47 pid: 5850 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.918878:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681babb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875420968465152:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541074.918900:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.918923:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541074.918928:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541074.919061:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788541074.919372:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788541074.919526:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968465280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788541074.919577:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541074.919608:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541074.919663:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968465280 00000100:00100000:2.0:1788541074.919668:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968465280 00000100:00100000:2.0:1788541074.919701:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541074.919706:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875420968465280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541074.919769:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875420968465280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.919774:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541074.919843:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968465280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788541074.920351:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788541074.920429:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968465408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788541074.920463:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541074.920522:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788541074.920695:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968465408 00000100:00100000:2.0:1788541074.920699:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968465408 00000100:00100000:2.0:1788541074.920721:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541074.920725:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875420968465408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541074.920873:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5853:x1875420968465408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 146us (408us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788541074.920880:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788541074.920965:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf682d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875420968465408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788541074.921000:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788541074.921024:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.921031:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.921036:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.921040:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541074.921043:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.921049:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.921060:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:3.0:1788541074.921062:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788541074.921065:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541074.921069:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031600/0xc9a6a13d3cd1b841 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541074.921375:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788541074.921618:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788541074.921629:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359921219959ns, next at 360921217567ns, rc = 0 00000001:00080000:0.0:1788541074.921636:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788541074.921661:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553200) 00010000:00010000:0.0:1788541074.921663:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788541074.921668:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b82c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18ec expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541074.921776:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+50:11576:x1875420945405824:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 6896us (7024us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788541074.921782:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000020:00080000:0.0:1788541074.921785:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788541074.923822:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.923864:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945406080 00000100:00100000:3.0:1788541074.923938:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945406080 00000100:00100000:3.0:1788541074.924000:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 203 00000100:00100000:3.0:1788541074.924011:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+50:11576:x1875420945406080:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541074.924035:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541074.924082:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b848 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18f3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.924292:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18f3 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.924308:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b848 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18f3 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.924339:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541074.924343:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541074.924346:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603400, rc 0) 00000100:00100000:2.0:1788541074.924394:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681bab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+51:11576:x1875420945406080:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 386us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.924400:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 203 00000100:00100000:1.0:1788541074.926272:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541074.926365:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945406336 00000100:00100000:3.0:1788541074.926372:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945406336 00000100:00100000:0.0:1788541074.926456:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:0.0:1788541074.926468:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+51:11576:x1875420945406336:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541074.926692:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+52:11576:x1875420945406336:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 226us (428us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788541074.926700:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1788541074.987781:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541074.987970:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945406464 00000100:00100000:2.0:1788541074.987981:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945406464 00000100:00100000:2.0:1788541074.988044:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 204 00000100:00100000:2.0:1788541074.988055:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:11586:x1875420945406464:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:2.0:1788541074.988339:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988361:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988375:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988396:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988404:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988453:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988550:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988822:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988830:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541074.988965:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988979:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988986:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988991:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.988997:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.989001:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989009:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989022:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541074.989025:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.989030:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989036:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b84f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989058:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989064:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989621:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989631:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.989634:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989641:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989651:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553a00) 00010000:00010000:2.0:1788541074.989653:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.989657:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989662:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989682:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989689:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989695:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989709:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541074.989712:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989719:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989727:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541074.989730:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541074.989733:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541074.989739:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b85d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541074.989842:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+52:11586:x1875420945406464:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 1784us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.989852:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 204 00010000:00010000:2.0:1788541075.031809:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541075.031951:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541075.032017:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945406720 00000100:00100000:2.0:1788541075.032027:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945406720 00000100:00100000:2.0:1788541075.032154:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 205 00000100:00100000:2.0:1788541075.032177:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+52:11589:x1875420945406720:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541075.032201:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541075.032221:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac18fa expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032296:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032325:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032336:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032352:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032360:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032367:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032492:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032498:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032502:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541075.032508:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788541075.032588:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032595:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032602:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032613:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541075.032618:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032627:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032639:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541075.032641:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541075.032644:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032649:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603e00/0xc9a6a13d3cd1b86b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032659:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032663:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032667:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032669:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541075.032671:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032674:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032687:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553a00) 00010000:00010000:2.0:1788541075.032688:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541075.032690:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032694:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032724:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032732:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.032736:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541075.032738:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541075.032740:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602400, rc 0) 00000100:00100000:2.0:1788541075.032781:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+54:11589:x1875420945406720:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 618us (839us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788541075.032786:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 205 00000100:00080000:0.0:1788541075.033242:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541075.035000:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.035043:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945406848 00000100:00100000:3.0:1788541075.035052:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945406848 00000100:00100000:3.0:1788541075.035164:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:3.0:1788541075.035175:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+54:11589:x1875420945406848:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:3.0:1788541075.035718:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035735:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035746:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035769:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035773:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035778:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035782:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cda00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541075.035785:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035803:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035811:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541075.035813:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541075.035816:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.035820:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541075.035878:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+54:11589:x1875420945406848:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 704us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541075.035885:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 206 00000100:00100000:1.0:1788541075.037316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541075.037363:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945407104 00000100:00100000:2.0:1788541075.037372:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945407104 00000100:00100000:0.0:1788541075.037450:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:0.0:1788541075.037462:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+54:11589:x1875420945407104:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541075.037665:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+55:11589:x1875420945407104:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 204us (352us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788541075.037672:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:1.0:1788541075.108124:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541075.108243:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945407360 00000100:00100000:2.0:1788541075.108254:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945407360 00000100:00100000:2.0:1788541075.108318:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 207 00000100:00100000:2.0:1788541075.108328:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+55:11599:x1875420945407360:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:2.0:1788541075.108351:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541075.108362:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788541075.108390:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd600/0xc9a6a13d3cd1b809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18de expref: 55 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.108442:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541075.108448:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541075.108462:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b88e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1901 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.108572:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.108590:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.108599:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.108630:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.108645:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 55 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541075.108660:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968465536:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541075.108756:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541075.112836:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968465536:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541075.112881:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541075.113969:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.114055:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945407488 00000100:00100000:3.0:1788541075.114064:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945407488 00010000:00010000:3.0:1788541075.114109:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 56 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541075.114152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:3.0:1788541075.114162:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+56:2358:x1875420945407488:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541075.114178:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541075.114194:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 56 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.114207:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 56 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.114255:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18fa expref: 56 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.114271:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541075.114275:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.114285:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.114292:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.114324:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541075.114380:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+55:2358:x1875420945407488:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 219us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541075.114387:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00010000:00010000:0.0:1788541075.114466:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.114475:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541075.114495:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788541075.114654:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b88e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.114669:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.114689:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:0.0:1788541075.114692:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541075.114695:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:0.0:1788541075.114738:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681babb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+55:11599:x1875420945407360:12345-192.168.202.59@tcp:101:bash.0 Request processed in 6411us (6624us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788541075.114745:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 207 00000100:00100000:1.0:1788541075.117460:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541075.117548:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945407744 00000100:00100000:2.0:1788541075.117557:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945407744 00000100:00100000:2.0:1788541075.117619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 208 00000100:00100000:2.0:1788541075.117642:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+55:11599:x1875420945407744:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1788541075.117886:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.117934:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.117947:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541075.117998:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788541075.118026:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7c00456 reply state 000000000e45579a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541075.118034:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541075.118132:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681bab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+58:11599:x1875420945407744:12345-192.168.202.59@tcp:36:bash.0 Request processed in 492us (679us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788541075.118139:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 208 00000020:00080000:2.0:1788541075.118143:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788541075.121026:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.121044:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.121051:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.121057:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541075.121062:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.121079:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.121096:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:1.0:1788541075.121099:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541075.121103:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.121109:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b8a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541075.122154:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.122510:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945407872 00000100:00100000:3.0:1788541075.122519:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945407872 00000100:00100000:3.0:1788541075.122578:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 209 00000100:00100000:3.0:1788541075.122589:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+57:11599:x1875420945407872:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541075.122615:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541075.122635:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1908 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.122706:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.122728:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.122734:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.122764:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.122773:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 58 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541075.122783:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968465664:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541075.122846:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541075.124931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541075.124990:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945408000 00000100:00100000:1.0:1788541075.124997:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945408000 00010000:00010000:1.0:1788541075.125028:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 59 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541075.125060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:1.0:1788541075.125074:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+59:2359:x1875420945408000:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541075.125088:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541075.125095:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 59 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.125108:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 59 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.125130:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:1.0:1788541075.125134:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.125143:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.125151:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541075.125169:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541075.125242:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+59:2359:x1875420945408000:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 164us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541075.125265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00010000:00010000:3.0:1788541075.125732:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b895 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1901 expref: 58 pid: 5850 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541075.125746:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875420968465664:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541075.125764:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.125770:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.125774:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541075.125811:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788541075.125819:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541075.125837:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.125859:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.125869:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.125876:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541075.125879:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541075.125882:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc200, rc 0) 00000100:00100000:3.0:1788541075.125968:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+57:11599:x1875420945407872:12345-192.168.202.59@tcp:101:bash.0 Request processed in 3381us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541075.125974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 209 00000100:00100000:2.0:1788541075.128879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541075.128983:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945408256 00000100:00100000:0.0:1788541075.128991:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945408256 00000100:00100000:0.0:1788541075.129040:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:0.0:1788541075.129050:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+57:11599:x1875420945408256:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1788541075.129300:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+58:11599:x1875420945408256:12345-192.168.202.59@tcp:35:bash.0 Request processed in 251us (429us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788541075.129308:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:1.0:1788541075.184239:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541075.184532:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945408384 00000100:00100000:2.0:1788541075.184542:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945408384 00000100:00100000:2.0:1788541075.184648:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:2.0:1788541075.184658:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+58:11605:x1875420945408384:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541075.184679:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541075.184697:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b8b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac190f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.184748:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b8bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.184771:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.184780:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541075.184811:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788541075.184813:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541075.184825:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.184843:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b8b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac190f expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.184857:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b8bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac190f expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.184862:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541075.184864:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541075.184867:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541075.184946:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945408384:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 289us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541075.184953:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 210 00000100:00100000:1.0:1788541075.187344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541075.187552:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945408512 00000100:00100000:0.0:1788541075.187561:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945408512 00000100:00100000:0.0:1788541075.187661:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 211 00000100:00100000:0.0:1788541075.187669:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945408512:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541075.187685:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541075.187701:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b8c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1916 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187745:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187756:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187770:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187780:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187784:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187788:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187859:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187864:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187867:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541075.187914:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788541075.187918:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541075.187941:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187953:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187961:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187975:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187979:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187984:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541075.187987:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.187992:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188001:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:0.0:1788541075.188003:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541075.188005:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188009:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1b8cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188018:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188021:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188025:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188027:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541075.188032:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188036:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188040:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d78b22b900) 00010000:00010000:0.0:1788541075.188042:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541075.188043:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188046:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1b8d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188070:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6c00/0xc9a6a13d3cd1b8c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1916 expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188083:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1916 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.188089:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:0.0:1788541075.188091:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541075.188093:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6800, rc 0) 00000100:00100000:0.0:1788541075.188191:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+60:11605:x1875420945408512:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 521us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541075.188199:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 211 00000100:00100000:1.0:1788541075.191638:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.191723:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945408640 00000100:00100000:3.0:1788541075.191735:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945408640 00000100:00100000:3.0:1788541075.191806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1788541075.191817:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+60:2358:x1875420945408640:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541075.191833:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541075.191858:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6800/0xc9a6a13d3cd1b8db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1916 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.191878:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541075.191883:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541075.191954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+59:2358:x1875420945408640:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 138us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541075.191982:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1788541075.195119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.195208:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945408896 00000100:00100000:3.0:1788541075.195220:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945408896 00000100:00100000:3.0:1788541075.195298:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:3.0:1788541075.195310:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945408896:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541075.195332:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541075.195355:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac191d expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.195500:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.195516:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.195524:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.195558:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.195572:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 60 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541075.195586:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968465792:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541075.195689:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788541075.199228:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541075.199302:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945409024 00000100:00100000:0.0:1788541075.199312:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945409024 00010000:00010000:0.0:1788541075.199355:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 61 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541075.199380:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968465792:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541075.199441:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541075.199441:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:0.0:1788541075.199450:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+61:2358:x1875420945409024:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541075.199467:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541075.199474:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 61 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.199486:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 61 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.199508:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc200/0xc9a6a13d3cd1b8b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1908 expref: 61 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.199523:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:0.0:1788541075.199528:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.199537:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.199544:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541075.199575:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541075.199640:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+60:2358:x1875420945409024:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541075.199648:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00010000:00010000:3.0:1788541075.199704:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.199712:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541075.199732:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788541075.199944:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 61 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.199961:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 60 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.199970:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541075.199972:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541075.199975:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cce00, rc 0) 00000100:00100000:3.0:1788541075.200013:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+60:11605:x1875420945408896:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 4705us (4904us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788541075.200020:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 212 00000100:00100000:1.0:1788541075.203231:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.203274:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945409280 00000100:00100000:3.0:1788541075.203285:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945409280 00000100:00100000:3.0:1788541075.203355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1788541075.203366:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+60:11605:x1875420945409280:12345-192.168.202.59@tcp:103:lfs.0 00010000:00010000:3.0:1788541075.203383:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541075.203433:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603400/0xc9a6a13d3cd1b848 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18f3 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.203468:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541075.203474:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541075.203524:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945409280:12345-192.168.202.59@tcp:103:lfs.0 Request processed in 159us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541075.203532:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541075.205261:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541075.205336:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945409408 00000100:00100000:3.0:1788541075.205345:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945409408 00000100:00100000:3.0:1788541075.205399:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:3.0:1788541075.205437:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945409408:12345-192.168.202.59@tcp:58:lfs.0 00010000:00010000:3.0:1788541075.205540:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.205557:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541075.205580:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541075.205780:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788541075.205866:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945409408:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 458us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541075.205874:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 213 00000100:00100000:1.0:1788541075.208333:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541075.208385:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945409536 00000100:00100000:2.0:1788541075.208394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945409536 00000100:00100000:2.0:1788541075.208483:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 214 00000100:00100000:2.0:1788541075.208492:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+59:11605:x1875420945409536:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541075.208525:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541075.208547:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1924 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.208612:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.208623:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.208642:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.208655:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.208669:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541075.208672:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541075.208676:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541075.208684:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602c00, rc 0) 00000100:00100000:2.0:1788541075.208746:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+60:11605:x1875420945409536:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 254us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541075.208753:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 214 00000040:00080000:1.0:1788541075.994201:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541075.994211:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541075.994246:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788541075.994253:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541075.994388:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adfe1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968465920:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541075.996088:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541076.002979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.003340:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945409664 00000100:00100000:2.0:1788541076.003352:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945409664 00000100:00100000:2.0:1788541076.003454:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:2.0:1788541076.003482:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945409664:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788541076.003516:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788541076.003662:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945409664:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 181us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.003670:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 215 00000100:00100000:0.0:1788541076.004323:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adfe1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968465920:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541076.012188:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.012293:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945409792 00000100:00100000:2.0:1788541076.012304:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945409792 00000100:00100000:2.0:1788541076.012371:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:2.0:1788541076.012380:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+60:11606:x1875420945409792:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788541076.012470:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012487:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012499:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012514:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012520:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012526:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012550:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012576:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012584:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541076.012624:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788541076.012628:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541076.012643:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012653:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012659:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012666:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012672:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.012676:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012683:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012694:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:2.0:1788541076.012697:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541076.012701:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012719:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b905 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012736:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012742:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012747:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012753:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.012756:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012763:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012771:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff98d786553a00) 00010000:00010000:2.0:1788541076.012774:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541076.012777:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012782:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b90c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012796:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012802:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012814:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012819:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.012822:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012827:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012835:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541076.012837:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541076.012840:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.012845:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.013010:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+60:11606:x1875420945409792:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 629us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.013018:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 216 00000100:00100000:1.0:1788541076.023002:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.023099:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945410048 00000100:00100000:2.0:1788541076.023110:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945410048 00000100:00100000:2.0:1788541076.023172:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:2.0:1788541076.023183:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+60:11606:x1875420945410048:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541076.023204:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541076.023224:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b91a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac192b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023348:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023364:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023376:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541076.023388:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788541076.023513:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023520:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023526:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023531:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.023535:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023543:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023555:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541076.023557:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788541076.023563:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023578:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023621:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b91a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac192b expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023632:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:2.0:1788541076.023634:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541076.023638:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b91a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac192b expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.023647:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603c00, rc 0) 00000100:00100000:2.0:1788541076.023719:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945410048:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 536us (729us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788541076.023727:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 217 00000100:00100000:1.0:1788541076.029695:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.030087:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945410176 00000100:00100000:3.0:1788541076.030099:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945410176 00000100:00100000:3.0:1788541076.030164:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:3.0:1788541076.030175:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945410176:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788541076.030212:0:9724:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788541076.030345:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945410176:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 171us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.030353:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 218 00000100:00100000:0.0:1788541076.038627:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.039155:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945410432 00000100:00100000:2.0:1788541076.039166:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945410432 00000100:00100000:2.0:1788541076.039227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:2.0:1788541076.039252:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945410432:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541076.039273:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541076.039276:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788541076.039301:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b8bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac190f expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.039322:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:2.0:1788541076.039327:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541076.039358:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b92f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1932 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541076.046078:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788541076.046453:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.046471:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.046485:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.046556:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1b92f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1932 expref: 63 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.046578:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1932 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.046587:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d786553a00) 00010000:00010000:2.0:1788541076.046590:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541076.046594:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:2.0:1788541076.046678:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+62:11606:x1875420945410432:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 7441us (8061us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788541076.046687:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 219 00000100:00100000:1.0:1788541076.057596:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:0.0:1788541076.057731:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541076.058612:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945410688 00000100:00100000:3.0:1788541076.058624:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945410688 00000100:00100000:3.0:1788541076.058688:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 220 00000100:00100000:3.0:1788541076.058699:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+62:11606:x1875420945410688:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541076.058770:0:9724:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541076.058799:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602000/0xc9a6a13d3cd1b936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1932 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059013:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d786553a00) 00010000:00010000:3.0:1788541076.059025:0:9724:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541076.059049:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059075:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059086:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059146:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059153:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059161:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059255:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059263:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059270:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059276:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cca00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541076.059280:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059288:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059297:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541076.059300:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541076.059304:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059310:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b944 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059321:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059326:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059331:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059344:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541076.059347:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059353:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059362:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa304113f (ffff98d78320d500) 00010000:00010000:3.0:1788541076.059365:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541076.059367:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.059374:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b94b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa304113f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.059488:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945410688:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 790us (1902us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541076.059497:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 220 00000100:00100000:1.0:1788541076.066664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.066752:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945410816 00000100:00100000:3.0:1788541076.066763:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945410816 00000100:00100000:3.0:1788541076.066833:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:3.0:1788541076.066852:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+61:11606:x1875420945410816:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541076.066873:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541076.066909:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1939 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.066947:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.066979:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.066991:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.067101:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.067120:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.067129:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541076.067132:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541076.067136:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cca00, rc 0) 00000100:00100000:3.0:1788541076.067199:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+62:11606:x1875420945410816:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 356us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.067207:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 221 00000100:00100000:0.0:1788541076.079482:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.079593:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945411072 00000100:00100000:3.0:1788541076.079605:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945411072 00000100:00100000:3.0:1788541076.079670:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 222 00000100:00100000:3.0:1788541076.079680:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+62:11606:x1875420945411072:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541076.079787:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.079804:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.079839:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541076.080128:0:9724:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788541076.080138:0:9724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361079728174ns, next at 362079725745ns, rc = 0 00000004:00010000:3.0:1788541076.080232:0:9724:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002762386d reply state 0000000066fa9fa6 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.080241:0:9724:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541076.080690:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+64:11606:x1875420945411072:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1009us (1219us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788541076.080699:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 222 00010000:00010000:2.0:1788541076.084612:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.084629:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.084654:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.084659:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.084664:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.084671:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.084688:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541076.084691:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788541076.084695:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.084700:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b960 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.091014:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.091293:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945411200 00000100:00100000:3.0:1788541076.091304:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945411200 00000100:00100000:3.0:1788541076.091361:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:3.0:1788541076.091372:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+63:11606:x1875420945411200:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541076.091396:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541076.091444:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1940 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.091511:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.091525:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.091543:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541076.091559:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541076.091563:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd000, rc 0) 00000100:00100000:3.0:1788541076.091628:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+64:11606:x1875420945411200:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 258us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.091634:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 223 00000100:00100000:1.0:1788541076.098318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.098455:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945411328 00000100:00100000:0.0:1788541076.098467:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945411328 00000100:00100000:0.0:1788541076.098557:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:0.0:1788541076.098569:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+9:2358:x1875420945411328:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788541076.099112:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541076.099185:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+10:2358:x1875420945411328:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 618us (878us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788541076.099194:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:1.0:1788541076.102980:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.103180:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945411584 00000100:00100000:2.0:1788541076.103191:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945411584 00000100:00100000:2.0:1788541076.103251:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:2.0:1788541076.103262:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+64:11606:x1875420945411584:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788541076.103536:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+65:11606:x1875420945411584:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 275us (566us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788541076.103544:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:2.0:1788541076.109202:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.109377:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945411840 00000100:00100000:0.0:1788541076.109386:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945411840 00000100:00100000:0.0:1788541076.109484:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 224 00000100:00100000:0.0:1788541076.109495:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+65:11606:x1875420945411840:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788541076.109598:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+65:11606:x1875420945411840:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 105us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.109605:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 224 00000100:00100000:1.0:1788541076.112741:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.112854:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945411968 00000100:00100000:3.0:1788541076.112865:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945411968 00000100:00100000:3.0:1788541076.112944:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:3.0:1788541076.112954:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+65:11606:x1875420945411968:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541076.112973:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541076.112995:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b96e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1947 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.113081:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.113094:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.113107:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541076.113145:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541076.113164:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.113190:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b96e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1947 expref: 67 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.113207:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1947 expref: 66 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.113230:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541076.113233:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788541076.113237:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc800, rc 0) 00000100:00100000:3.0:1788541076.113308:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+66:11606:x1875420945411968:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 355us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.113316:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 225 00000100:00100000:1.0:1788541076.119280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.119695:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412096 00000100:00100000:2.0:1788541076.119723:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412096 00000100:00100000:2.0:1788541076.119786:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:2.0:1788541076.119798:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+10:2359:x1875420945412096:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541076.119826:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541076.119979:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac194e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541076.120009:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af894, blocks: 0x1 00010000:00010000:2.0:1788541076.120044:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788541076.120048:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541076.120070:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.120090:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.120104:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602e00, rc 0) 00000100:00100000:2.0:1788541076.120163:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+11:2359:x1875420945412096:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 367us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.120171:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:0.0:1788541076.138541:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.138651:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412352 00000100:00100000:2.0:1788541076.138661:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412352 00000100:00100000:2.0:1788541076.138718:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 226 00000100:00100000:2.0:1788541076.138729:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+66:11606:x1875420945412352:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541076.138825:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+66:11606:x1875420945412352:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 98us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.138863:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 226 00000100:00100000:1.0:1788541076.150098:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.150252:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412480 00000100:00100000:0.0:1788541076.150263:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412480 00000100:00100000:0.0:1788541076.150322:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:0.0:1788541076.150332:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+11:11606:x1875420945412480:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541076.150351:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541076.150384:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1955 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.150452:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.150462:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541076.150467:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541076.150472:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.150504:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.150534:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.150548:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875420968466048:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541076.150871:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788541076.154019:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875420968466048:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541076.154055:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.154089:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6a00, rc 0) 00000100:00100000:0.0:1788541076.154155:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+12:11606:x1875420945412480:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 3823us (4067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.154181:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:2.0:1788541076.164823:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.166752:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412608 00000100:00100000:0.0:1788541076.166766:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412608 00010000:00010000:0.0:1788541076.166830:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.166889:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:0.0:1788541076.166911:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+12:2358:x1875420945412608:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541076.166928:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541076.166952:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.166967:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.166990:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a11ac97/0xc9a6a13d3cd1b97c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac194e expref: 12 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.167007:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541076.167012:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541076.167025:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.167036:0:6720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.167101:0:6720:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.167119:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6720:1875420968466176:192.168.202.59@tcp:105: 00000100:00100000:0.0:1788541076.167225:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788541076.169883:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc718a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6720:1875420968466176:192.168.202.59@tcp:105: 00010000:00010000:0.0:1788541076.169920:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541076.169983:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+11:2358:x1875420945412608:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 3072us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.169995:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:2.0:1788541076.175749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541076.175866:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412736 00000100:00100000:1.0:1788541076.175877:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412736 00002000:00100000:1.0:1788541076.175941:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98d7bf4c5f80 x1875420945412736/t0(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:447/0 lens 504/0 e 0 to 0 dl 1788541087 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541076.175967:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7bf4c5f80 with x1875420945412736 ext(0->12) 00002000:00010000:1.0:1788541076.175973:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7bf4c5f80 00000100:00100000:1.0:1788541076.176040:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1788541076.176050:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+11:2359:x1875420945412736:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788541076.176722:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:103c367e-0a85-454e-8289-79a7b521f7f2+13:2359:x1875420945412736:12345-192.168.202.59@tcp:4:lhsmtool_posix.0 Request processed in 672us (1316us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788541076.176731:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00002000:00100000:1.0:1788541076.176739:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff98d7bf4c5f80 x1875420945412736/t4294967320(0) o4->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:447/0 lens 504/448 e 0 to 0 dl 1788541087 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541076.176747:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d7bf4c5f80 with x1875420945412736 ext(0->12) 00002000:00010000:1.0:1788541076.176751:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d7bf4c5f80 00000100:00100000:2.0:1788541076.185760:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.185868:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412864 00000100:00100000:3.0:1788541076.185877:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412864 00000100:00100000:3.0:1788541076.185979:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:3.0:1788541076.185990:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+66:11606:x1875420945412864:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788541076.216485:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:1.0:1788541076.216535:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d791059900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788541076.216541:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d7910593c0 00000020:00080000:1.0:1788541076.216544:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7899f9c00 00000001:00080000:1.0:1788541076.216574:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788541076.216596:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1788541076.216618:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788541076.216623:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788541076.216637:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d7ae0c9c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788541076.216639:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b2c8c500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d7ae0c93c0 00000020:00080000:1.0:1788541076.216641:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b2c8c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7bf71a400 00000020:00080000:3.0:1788541076.216734:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788541076.216876:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788541076.216984:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541076.217005:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968466304:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788541076.217085:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541076.217130:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968466304 00000100:00100000:3.0:1788541076.217138:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968466304 00000100:00100000:3.0:1788541076.217195:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788541076.217205:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3316:x1875420968466304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788541076.217231:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788541076.217257:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9af892, atime: 0x6a9af892, ctime: 0x6a9af892, blocks: 0x1 00010000:00010000:3.0:1788541076.217263:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.217276:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788541076.217293:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541076.217300:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.217316:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.217327:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.217334:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.217353:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541076.217838:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3316:x1875420968466304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 635us (752us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788541076.217844:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788541076.217975:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541076.217981:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.217990:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541076.217995:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.218004:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.218033:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.218040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021539421/0xc9a6a13d3cd1b98a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.218117:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541076.218119:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541076.218121:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788541076.218129:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788541076.218161:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7adc68380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788541076.218167:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968466304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788541076.218326:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+20:11606:x1875420945412864:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 32336us (32575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.218336:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 227 00000100:00100000:1.0:1788541076.219538:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968466432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788541076.219599:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.219632:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541076.219638:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968466560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788541076.219644:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968466432 00000100:00100000:2.0:1788541076.219651:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968466432 00000100:00100000:1.0:1788541076.219657:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.219693:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968466560 00000100:00100000:2.0:1788541076.219697:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968466560 00000100:00100000:2.0:1788541076.219715:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788541076.219723:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968466432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788541076.219746:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788541076.219766:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.219784:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.219793:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788541076.219797:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541076.219802:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541076.219814:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541076.219822:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968466560:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788541076.219829:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.219841:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 12 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.219865:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968466688:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541076.219930:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831b6f00 going to sleep for 11 seconds 00002000:00010000:1.0:1788541076.219958:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788541076.219961:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788541076 00002000:00010000:1.0:1788541076.219964:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788541076.219966:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788541076 -> 1788541076 00002000:00010000:1.0:1788541076.219969:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788541076.220005:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875420968466560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (346us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788541076.220012:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1788541076.220047:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7bf4c7100/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788541076.220052:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968466560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788541076.222477:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541076.222505:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945412992 00000100:00100000:1.0:1788541076.222515:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945412992 00000100:00080000:2.0:1788541076.222634:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541076.222659:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1788541076.222670:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+13:2360:x1875420945412992:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788541076.222887:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968466688:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541076.222891:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:2.0:1788541076.222922:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.223215:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945413120 00000100:00100000:3.0:1788541076.223220:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945413120 00010000:00010000:3.0:1788541076.223245:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 14 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.223268:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:3.0:1788541076.223276:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+14:2359:x1875420945413120:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541076.223287:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541076.223293:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 14 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.223314:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 14 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.223346:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009af35cd4/0xc9a6a13d3cd1b74c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac18b4 expref: 14 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.223359:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541076.223362:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541076.223367:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.223374:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.223396:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541076.223424:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.223434:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.223445:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.223453:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.223480:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541076.223492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+13:2359:x1875420945413120:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 217us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.223499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00010000:00010000:2.0:1788541076.224513:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541076.224523:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.224534:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541076.224538:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.224556:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.224571:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.224578:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf2dc64/0xc9a6a13d3cd1b991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.224608:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541076.224610:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541076.224611:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541076.225259:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1875420968466432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5534us (5656us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788541076.225267:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788541076.227131:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7bf4c4380/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788541076.227145:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968466432:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788541076.240874:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788541076.240905:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788541076.240924:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788541076.241267:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945412992:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 18593us (18792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.241280:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:1.0:1788541076.245515:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.245691:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945413376 00000100:00100000:2.0:1788541076.245703:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945413376 00000100:00100000:2.0:1788541076.245803:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 228 00000100:00100000:2.0:1788541076.245814:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:11606:x1875420945413376:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788541076.245869:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541076.245908:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc800/0xc9a6a13d3cd1b975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1947 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.245928:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541076.245933:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541076.245964:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.245978:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.245989:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541076.246510:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf3fc419 reply state 000000004e6d3a5b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.246541:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541076.246663:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:11606:x1875420945413376:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 848us (1156us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788541076.246670:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 228 00010000:00010000:3.0:1788541076.249646:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.249664:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.249671:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.249677:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541076.249682:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.249707:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.249724:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541076.249727:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541076.249732:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.249739:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1b998 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541076.249797:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.249852:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945413504 00000100:00100000:0.0:1788541076.249861:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945413504 00000100:00100000:0.0:1788541076.249927:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:0.0:1788541076.249939:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+7:2358:x1875420945413504:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788541076.250154:0:9248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788541076.250158:0:9248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788541076 -> 1788541075 00002000:00010000:0.0:1788541076.250161:0:9248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788541074 00002000:00010000:0.0:1788541076.250163:0:9248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788541076 -> 1788541075 00002000:00010000:0.0:1788541076.250166:0:9248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788541076.250226:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945413504:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 290us (431us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788541076.250234:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 70 00000100:00100000:0.0:1788541076.255290:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.255486:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945413760 00000100:00100000:2.0:1788541076.255496:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945413760 00000100:00100000:2.0:1788541076.255636:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:2.0:1788541076.255648:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+20:11606:x1875420945413760:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788541076.255726:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.255743:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.255753:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.255789:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.255802:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 20 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.255815:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968466816:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541076.255964:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b3786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541076.267940:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.268080:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875420968466816:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541076.268122:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.268187:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945413888 00000100:00100000:3.0:1788541076.268196:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945413888 00010000:00010000:3.0:1788541076.268245:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.268285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:3.0:1788541076.268295:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:2359:x1875420945413888:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541076.268309:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541076.268316:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.268328:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.268349:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1939 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.268379:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:3.0:1788541076.268384:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.268393:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.268402:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.268468:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541076.268519:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adfe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:2359:x1875420945413888:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 225us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.268527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00010000:00010000:2.0:1788541076.268610:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268617:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268646:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268652:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268659:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268664:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.268669:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268677:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268686:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541076.268689:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788541076.268692:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.268699:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b99f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.268748:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+19:11606:x1875420945413760:12345-192.168.202.59@tcp:55:lhsmtool_posix.0 Request processed in 13103us (13470us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788541076.268756:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 229 00000100:00100000:1.0:1788541076.275916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.276025:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945414016 00000100:00100000:0.0:1788541076.276035:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945414016 00000100:00100000:0.0:1788541076.276090:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:0.0:1788541076.276112:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945414016:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788541076.276164:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.276184:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.276208:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541076.276212:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541076.276217:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.276255:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.276269:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 8 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.276285:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968466944:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541076.276525:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788541076.283317:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875420968466944:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541076.283350:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541076.283550:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.284003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945414144 00000100:00100000:0.0:1788541076.284011:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945414144 00010000:00010000:0.0:1788541076.284050:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.284154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:0.0:1788541076.284165:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+9:2359:x1875420945414144:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541076.284195:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541076.284219:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.284232:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.284254:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cd79a3c/0xc9a6a13d3cd1b983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1955 expref: 9 pid: 6706 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.284270:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541076.284274:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541076.284280:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.284289:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.284877:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541076.284943:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945414144:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 777us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.284950:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00010000:00010000:1.0:1788541076.285027:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285037:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285063:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285072:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285080:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285086:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541076.285090:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285099:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285146:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.285152:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e8e8c43/0xc9a6a13d3cd1b9a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541076.285199:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945414016:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 9100us (9304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.285207:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 71 00000100:00100000:1.0:1788541076.291999:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.292088:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945414400 00000100:00100000:3.0:1788541076.292100:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945414400 00000100:00100000:3.0:1788541076.292213:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 230 00000100:00100000:3.0:1788541076.292224:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+19:11606:x1875420945414400:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788541076.292304:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292320:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292332:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292584:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292607:0:9724:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292616:0:9724:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292647:0:9724:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.292659:0:9724:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 20 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541076.292673:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968467072:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541076.292745:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090840 going to sleep for 11 seconds 00000100:00100000:1.0:1788541076.296598:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.296742:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc6aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968467072:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541076.296771:0:9724:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.296850:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945414528 00000100:00100000:0.0:1788541076.296858:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945414528 00010000:00010000:0.0:1788541076.296910:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541076.296973:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:0.0:1788541076.296983:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:2358:x1875420945414528:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541076.297003:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541076.297010:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.297022:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.297044:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1b967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1940 expref: 21 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.297059:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:0.0:1788541076.297064:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.297074:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.297081:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.297113:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541076.297355:0:9724:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.297363:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541076.297588:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788541076.297732:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788541076.297773:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788541076.297845:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968467200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541076.297904:0:9724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.297938:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541076.298006:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c78c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:103c367e-0a85-454e-8289-79a7b521f7f2+23:2358:x1875420945414528:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 1022us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.298015:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:3.0:1788541076.298113:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968467200 00000100:00100000:3.0:1788541076.298119:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968467200 00000100:00100000:3.0:1788541076.298172:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541076.298180:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9724:x1875420968467200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788541076.298263:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9724:x1875420968467200:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.298269:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541076.298483:0:9724:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788541076.298489:0:9724:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788541076.298505:0:9724:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7bf4c7100, transno 4294967321 00000100:00100000:2.0:1788541076.298518:0:9724:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff98d7bf4c4380 x1875420968466432/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788541092 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541076.298529:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968467200:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788541076.298945:0:9724:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788541076.299005:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968467328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541076.299040:0:9724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.299058:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b3786c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541076.299133:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968467328 00000100:00100000:0.0:1788541076.299144:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968467328 00000100:00100000:0.0:1788541076.299182:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541076.299189:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9724:x1875420968467328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541076.299372:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9724:x1875420968467328:12345-0@lo:1000:mdt00_003.0 Request processed in 183us (330us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788541076.299379:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541076.299581:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9724:1875420968467328:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788541076.299622:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299632:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299639:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299645:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.299649:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299658:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299674:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78320d500) 00010000:00010000:2.0:1788541076.299678:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541076.299683:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299690:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc600/0xc9a6a13d3cd1b9b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299727:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299732:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299737:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299753:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cda00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.299756:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299762:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299770:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541076.299772:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541076.299779:0:9724:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299789:0:9724:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299798:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.299825:0:9724:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.299836:0:9724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968467456:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541076.299889:0:9724:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b3786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541076.304631:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.304705:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945414656 00000100:00100000:0.0:1788541076.304716:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945414656 00000100:00100000:0.0:1788541076.304772:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:0.0:1788541076.304780:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+24:11605:x1875420945414656:12345-192.168.202.59@tcp:49:lfs.0 00000100:00100000:0.0:1788541076.304908:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+24:11605:x1875420945414656:12345-192.168.202.59@tcp:49:lfs.0 Request processed in 127us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.304915:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:2.0:1788541076.305336:0:9724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9724:1875420968467456:192.168.202.59@tcp:105: 00010000:00010000:2.0:1788541076.305364:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305391:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cda00/0xc9a6a13d3cd1b8f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305463:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305477:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305489:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305498:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305505:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305512:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305517:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.305521:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305528:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305538:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541076.305542:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541076.305545:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305558:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305569:0:9724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305574:0:9724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305579:0:9724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305584:0:9724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cca00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541076.305586:0:9724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305591:0:9724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305598:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541076.305600:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541076.305603:0:9724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.305607:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1b9ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.305812:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+23:11606:x1875420945414400:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 13589us (13823us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788541076.305820:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 230 00000020:00080000:2.0:1788541076.305831:0:9724:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788541076.306108:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541076.306113:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541076.306689:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788541076.306699:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541076.311345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.311448:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945414912 00000100:00100000:0.0:1788541076.311459:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945414912 00000100:00100000:0.0:1788541076.311512:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:0.0:1788541076.311523:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+23:11605:x1875420945414912:12345-192.168.202.59@tcp:58:lfs.0 00000040:00080000:0.0:1788541076.311849:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788541076.311943:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+23:11605:x1875420945414912:12345-192.168.202.59@tcp:58:lfs.0 Request processed in 421us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.311951:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 231 00000100:00100000:2.0:1788541076.319532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.319933:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945415168 00000100:00100000:0.0:1788541076.319944:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945415168 00000100:00100000:0.0:1788541076.320026:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:0.0:1788541076.320036:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+23:11606:x1875420945415168:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788541076.320949:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788541076.321052:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788541076.323076:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.323095:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.323108:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.323118:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.323125:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.323131:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541076.323159:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788541076.323274:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+25:11606:x1875420945415168:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 3233us (3749us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788541076.323285:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000020:00080000:0.0:1788541076.323291:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541076.323711:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541076.323733:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.323740:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6a00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541076.323744:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.323753:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.323768:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff98d78b22bf00) 00010000:00010000:3.0:1788541076.323771:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788541076.323776:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.323781:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6a00/0xc9a6a13d3cd1b9c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.323800:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541076.323802:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541076.323804:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541076.348746:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541076.348849:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945415296 00000100:00100000:2.0:1788541076.348859:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945415296 00000100:00100000:2.0:1788541076.348936:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 232 00000100:00100000:2.0:1788541076.348947:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+25:11608:x1875420945415296:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541076.348972:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541076.348995:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac195c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349068:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349083:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349097:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349113:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349119:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349136:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349696:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349709:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 26 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349726:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349763:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 26 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541076.349776:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 26 pid: 9724 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541076.349791:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875420968467584:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541076.349938:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b3786c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541076.361848:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf5ca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875420968467584:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541076.361904:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541076.367087:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541076.367512:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945415552 00000100:00100000:0.0:1788541076.367527:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945415552 00000100:00100000:0.0:1788541076.367701:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:0.0:1788541076.367713:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+27:5598:x1875420945415552:12345-192.168.202.59@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788541076.367998:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:5598:x1875420945415552:12345-192.168.202.59@tcp:35:ldlm_bl.0 Request processed in 288us (924us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788541076.368005:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 63 00000100:00100000:3.0:1788541076.370119:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541076.370469:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945415680 00000100:00100000:1.0:1788541076.370479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945415680 00010000:00010000:1.0:1788541076.370522:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 28 pid: 9724 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541076.370581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:1.0:1788541076.370591:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+28:2359:x1875420945415680:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541076.370607:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541076.370614:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 28 pid: 9724 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.370646:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 28 pid: 9724 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.370669:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cce00/0xc9a6a13d3cd1b8e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac191d expref: 28 pid: 9724 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.370687:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:1.0:1788541076.370694:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.370703:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.370711:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541076.370743:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541076.370800:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:103c367e-0a85-454e-8289-79a7b521f7f2+27:2359:x1875420945415680:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 210us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.370807:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00010000:00010000:3.0:1788541076.371843:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.371856:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541076.371919:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788541076.371923:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541076.371949:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.371985:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.371996:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372003:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372009:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372014:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541076.372018:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372026:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372038:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541076.372041:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541076.372046:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372053:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372078:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372085:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372097:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372102:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541076.372105:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372112:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372121:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff98d786553700) 00010000:00010000:3.0:1788541076.372123:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541076.372126:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372132:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372170:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac195c expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372185:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac195c expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541076.372192:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541076.372194:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541076.372197:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603600, rc 0) 00000100:00100000:3.0:1788541076.372270:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+26:11608:x1875420945415296:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 23324us (23534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.372289:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 232 00000001:00080000:2.0:1788541076.552341:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788541076.552362:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788541076.552368:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788541076.552377:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1788541076.603097:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.603148:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.603179:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541076.603212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945415808 00000100:00100000:3.0:1788541076.603223:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945415808 00000100:00100000:3.0:1788541076.603277:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 297 00000100:00100000:3.0:1788541076.603287:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945415808:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541076.603358:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945415808:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.603365:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 297 00000100:00100000:3.0:1788541076.603399:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945416064 00000100:00100000:3.0:1788541076.603403:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945416064 00000100:00080000:2.0:1788541076.603463:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541076.603481:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 153 00000100:00100000:1.0:1788541076.603544:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945415936 00000100:00100000:1.0:1788541076.603562:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945415936 00000100:00100000:1.0:1788541076.603601:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:1.0:1788541076.603609:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945415936:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541076.603640:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2358:x1875420945415936:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.603646:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00080000:1.0:1788541076.603799:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541076.604468:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945416064:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541076.604526:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+5:2358:x1875420945416064:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 1036us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.604534:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 153 00010000:00010000:2.0:1788541077.099543:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541077.127623:0:12579:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541077.127635:0:12579:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541077.127685:0:12579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788541077.127691:0:12579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788541077.335730:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541077.335741:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541077.335772:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788541077.335777:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541077.335918:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bc71b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968467712:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541077.336036:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541077.340022:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bc71b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1875420968467712:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541077.341730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541077.342496:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945416192 00000100:00100000:3.0:1788541077.342507:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945416192 00000100:00080000:1.0:1788541077.342561:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541077.342599:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:3.0:1788541077.342613:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:11621:x1875420945416192:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788541077.342650:0:9724:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788541077.342760:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc71b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:103c367e-0a85-454e-8289-79a7b521f7f2+26:11621:x1875420945416192:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 152us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541077.342781:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 233 00000100:00100000:1.0:1788541077.347550:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541077.357276:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945416448 00000100:00100000:2.0:1788541077.357293:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945416448 00000100:00100000:2.0:1788541077.357404:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 234 00000100:00100000:2.0:1788541077.357458:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+26:11621:x1875420945416448:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541077.357479:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541077.357521:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.357626:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.357640:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.357652:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541077.357663:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788541077.357796:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1b9e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1963 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.357815:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1963 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.357825:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541077.357828:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541077.357831:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602600, rc 0) 00000100:00100000:2.0:1788541077.357918:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+28:11621:x1875420945416448:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 464us (10380us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788541077.357926:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 234 00000100:00100000:0.0:1788541077.363292:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541077.363668:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945416704 00000100:00100000:2.0:1788541077.363680:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945416704 00000100:00100000:2.0:1788541077.363750:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 235 00000100:00100000:2.0:1788541077.363760:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+28:11621:x1875420945416704:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788541077.363866:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.363893:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.363907:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364113:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364122:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364129:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364135:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541077.364139:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364147:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364159:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:2.0:1788541077.364162:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541077.364166:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541077.364172:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602e00/0xc9a6a13d3cd1b9fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541077.364348:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+29:11621:x1875420945416704:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 588us (1065us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788541077.364356:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 235 00000040:00080000:0.0:1788541077.364465:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541077.364470:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541077.364948:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788541077.364956:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541077.367992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541077.369188:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945416832 00000100:00100000:3.0:1788541077.369202:0:6720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945416832 00000100:00100000:3.0:1788541077.369291:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1788541077.369303:0:6720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+29:2359:x1875420945416832:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541077.369318:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541077.369341:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602600/0xc9a6a13d3cd1b9ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1963 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541077.369361:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541077.369366:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541077.369831:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541077.371421:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417088 00000100:00100000:2.0:1788541077.371435:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417088 00000100:00100000:2.0:1788541077.371492:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:2.0:1788541077.371502:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:11621:x1875420945417088:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788541077.371568:0:6720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:103c367e-0a85-454e-8289-79a7b521f7f2+29:2359:x1875420945416832:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 2265us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541077.371579:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1788541077.371734:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:11621:x1875420945417088:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 233us (1904us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788541077.371742:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 64 00000100:00100000:1.0:1788541077.463697:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541077.463720:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968467840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541077.463786:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541077.463927:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968467840 00000100:00100000:2.0:1788541077.463936:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968467840 00000100:00100000:2.0:1788541077.463983:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788541077.463993:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968467840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541077.464041:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541077.464089:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968467840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541077.464095:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788541077.464221:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788541077.464227:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1788541077.464244:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7adf54e00, transno 4294967307 00000004:00080000:1.0:1788541077.464261:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788541077.464272:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7adc68380, transno 4294967310 00000100:00100000:1.0:1788541077.464283:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968467840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788541078.104286:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541078.496090:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968468224:0@lo:400:kworker.0 00000100:00100000:3.0:1788541078.496164:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541078.496228:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788541078.496246:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968468096:0@lo:400:kworker.0 00000100:00100000:3.0:1788541078.496270:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541078.496287:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968468608:0@lo:400:kworker.0 00000100:00100000:3.0:1788541078.496311:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541078.496352:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468224 00000100:00100000:3.0:1788541078.496359:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468224 00000100:00100000:3.0:1788541078.496431:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468096 00000100:00100000:3.0:1788541078.496435:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468096 00000100:00100000:3.0:1788541078.496474:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788541078.496481:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968468224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541078.496543:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968468224:12345-0@lo:400:kworker.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541078.496550:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788541078.496568:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788541078.496574:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541078.496598:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968468096:12345-0@lo:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541078.496602:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788541078.496636:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968468096:0@lo:400:kworker.0 00000100:00100000:3.0:1788541078.496647:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968468224:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.496957:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968468352:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.496987:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541078.497016:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788541078.497022:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968467968:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497054:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541078.497077:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bb474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968468480:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497106:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541078.497128:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468480 00000100:00100000:2.0:1788541078.497132:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468480 00000100:00100000:2.0:1788541078.497157:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788541078.497164:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968468480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497195:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968468480:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541078.497201:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788541078.497221:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468608 00000100:00100000:2.0:1788541078.497223:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468608 00000100:00100000:2.0:1788541078.497257:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468352 00000100:00100000:2.0:1788541078.497260:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468352 00000100:00100000:2.0:1788541078.497276:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541078.497282:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875420968468608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497316:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1875420968468608:12345-0@lo:400:kworker.0 Request processed in 35us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541078.497322:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541078.497345:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541078.497351:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968468352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497379:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968468352:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541078.497384:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541078.497440:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968467968 00000100:00100000:2.0:1788541078.497443:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968467968 00000100:00100000:2.0:1788541078.497466:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788541078.497472:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968467968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497500:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968467968:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541078.497513:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788541078.497704:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968468608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497732:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968467968:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497741:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968468480:0@lo:400:kworker.0 00000100:00100000:2.0:1788541078.497749:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bb476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968468352:0@lo:400:kworker.0 00000100:00080000:1.0:1788541078.497991:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541078.497996:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541078.497999:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541079.000573:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541079.000599:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968468736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541079.000674:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541079.000747:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468736 00000100:00100000:2.0:1788541079.000754:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468736 00000100:00100000:2.0:1788541079.000797:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788541079.000805:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968468736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541079.000840:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541079.000894:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968468736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541079.000901:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788541079.002232:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968468736:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788541079.101115:0:12630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541079.101123:0:12630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541079.101166:0:12630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788541079.101171:0:12630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788541079.131999:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541079.369787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541079.370510:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417344 00000100:00100000:0.0:1788541079.370525:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417344 00000100:00100000:0.0:1788541079.370617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 236 00000100:00100000:0.0:1788541079.370631:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+29:11641:x1875420945417344:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541079.370661:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541079.370685:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1ba01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac196a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541079.370818:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1ba08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541079.370834:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1ba08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541079.370846:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1ba08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541079.370858:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788541079.371000:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6200/0xc9a6a13d3cd1ba01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac196a expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541079.371018:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1ba08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac196a expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541079.371027:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:0.0:1788541079.371043:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788541079.371047:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6400, rc 0) 00000100:00100000:0.0:1788541079.371114:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+31:11641:x1875420945417344:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 487us (1337us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788541079.371121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 236 00000100:00080000:1.0:1788541079.371585:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541079.383268:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541079.383307:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417472 00000100:00100000:1.0:1788541079.383316:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417472 00000100:00100000:1.0:1788541079.383369:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 237 00000100:00100000:1.0:1788541079.383380:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+31:11641:x1875420945417472:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:1.0:1788541079.383476:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383494:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383506:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383544:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383552:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383559:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383564:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541079.383569:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383576:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383588:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:1.0:1788541079.383592:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541079.383596:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541079.383603:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031000/0xc9a6a13d3cd1ba16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541079.383690:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+31:11641:x1875420945417472:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 312us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541079.383699:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 237 00000100:00100000:1.0:1788541079.494671:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541079.494755:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417600 00000100:00100000:2.0:1788541079.494764:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417600 00000100:00100000:2.0:1788541079.494828:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00100000:2.0:1788541079.494837:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2359:x1875420945417600:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:2.0:1788541079.494853:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541079.494893:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1ba1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1971 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541079.494919:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9af893, atime: 0x6a9af892, ctime: 0x6a9af893, blocks: 0xb 00010000:00010000:2.0:1788541079.494947:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1788541079.494951:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541079.494959:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1ba1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1971 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541079.494976:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1ba1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1971 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541079.494990:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603c00, rc 0) 00000100:00100000:2.0:1788541079.495041:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+8:2359:x1875420945417600:12345-192.168.202.59@tcp:101:cat.0 Request processed in 205us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541079.495048:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 72 00000100:00080000:1.0:1788541079.495313:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541079.514080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541079.514170:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417728 00000100:00100000:2.0:1788541079.514178:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417728 00002000:00100000:2.0:1788541079.514243:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98d681baa680 x1875420945417728/t0(0) o3->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:450/0 lens 488/0 e 0 to 0 dl 1788541090 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541079.514255:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d681baa680 with x1875420945417728 ext(0->4095) 00002000:00010000:2.0:1788541079.514260:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d681baa680 00000100:00100000:2.0:1788541079.514290:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788541079.514298:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945417728:12345-192.168.202.59@tcp:3:cat.0 00000100:00100000:2.0:1788541079.514485:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:103c367e-0a85-454e-8289-79a7b521f7f2+8:2358:x1875420945417728:12345-192.168.202.59@tcp:3:cat.0 Request processed in 188us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788541079.514504:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00002000:00100000:2.0:1788541079.514509:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff98d681baa680 x1875420945417728/t0(0) o3->103c367e-0a85-454e-8289-79a7b521f7f2@192.168.202.59@tcp:450/0 lens 488/4536 e 0 to 0 dl 1788541090 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541079.514515:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d681baa680 with x1875420945417728 ext(0->4095) 00002000:00010000:2.0:1788541079.514517:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff98d681baa680 00010000:00010000:3.0:1788541080.151647:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541081.178697:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788541081.621082:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788541081.621134:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d78b378780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788541081.621139:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d790c06900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d78b378c00 00000020:00080000:0.0:1788541081.621143:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d790c06e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d7adc24000 00000020:00080000:0.0:1788541081.621165:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788541081.621188:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788541081.621386:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788541081.635896:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788541081.637036:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:2.0:1788541081.730818:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541081.730870:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541081.730904:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541081.731007:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945418112 00000100:00100000:1.0:1788541081.731173:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945418112 00000100:00100000:1.0:1788541081.731252:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:1.0:1788541081.731263:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2361:x1875420945418112:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541081.731335:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:103c367e-0a85-454e-8289-79a7b521f7f2+5:2361:x1875420945418112:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 74us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541081.731342:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00080000:1.0:1788541081.731366:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541081.731940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417856 00000100:00100000:3.0:1788541081.731946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417856 00000100:00100000:3.0:1788541081.731987:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 299 00000100:00100000:3.0:1788541081.731995:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945417856:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541081.732095:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945417856:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 100us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541081.732102:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 299 00000100:00100000:3.0:1788541081.732160:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541081.739923:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541081.740123:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945418240 00000100:00100000:1.0:1788541081.740133:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945418240 00000100:00100000:1.0:1788541081.740204:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:1.0:1788541081.740215:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2361:x1875420945418240:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541081.740302:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+7:2361:x1875420945418240:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 89us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541081.740310:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00080000:3.0:1788541081.740872:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541081.747167:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945418368 00000100:00100000:0.0:1788541081.747188:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945418368 00000100:00100000:2.0:1788541081.747611:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945417984 00000100:00100000:2.0:1788541081.747617:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945417984 00000100:00100000:2.0:1788541081.747717:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 157 00000100:00100000:2.0:1788541081.747729:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:2361:x1875420945417984:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541081.747821:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:2361:x1875420945417984:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (15659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541081.747828:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 157 00000100:00100000:2.0:1788541081.747894:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 158 00000100:00100000:2.0:1788541081.747900:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945418368:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541081.747925:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+5:2361:x1875420945418368:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (17021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541081.747932:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 158 00000100:00080000:3.0:1788541081.748163:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788541082.202038:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541082.589454:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968468864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541082.589529:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541082.589602:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468864 00000100:00100000:2.0:1788541082.589616:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468864 00000100:00100000:2.0:1788541082.589684:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788541082.589693:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968468864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541082.589728:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541082.589770:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968468864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541082.589777:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788541082.589796:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541082.589831:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d6828ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968468864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788541083.223660:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541083.554134:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788541083.554151:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541083.556658:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788541083.556674:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541083.607889:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968469376:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.607975:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541083.608054:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788541083.608060:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968468992:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.608090:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541083.608112:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adfe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968469504:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.608137:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541083.608165:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968469120:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.608189:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541083.608207:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968469632:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.608227:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541083.608864:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541083.608873:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adfe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968469248:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.608904:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541083.608952:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469376 00000100:00100000:0.0:1788541083.608961:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469376 00000100:00100000:0.0:1788541083.609005:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469632 00000100:00100000:0.0:1788541083.609008:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469632 00000100:00100000:0.0:1788541083.609039:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788541083.609048:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968469376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.609105:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968469376:12345-0@lo:400:kworker.0 Request processed in 58us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.609112:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788541083.609137:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788541083.609144:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968469632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.609176:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968469632:12345-0@lo:400:kworker.0 Request processed in 34us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.609182:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788541083.609200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968468992 00000100:00100000:0.0:1788541083.609205:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968468992 00000100:00100000:0.0:1788541083.609230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788541083.609236:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968468992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.610733:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968468992:12345-0@lo:400:kworker.0 Request processed in 1489us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.610745:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788541083.610795:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469504 00000100:00100000:0.0:1788541083.610801:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469504 00000100:00100000:0.0:1788541083.610851:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469120 00000100:00100000:0.0:1788541083.610854:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469120 00000100:00100000:0.0:1788541083.610865:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469248 00000100:00100000:0.0:1788541083.610867:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469248 00000100:00100000:0.0:1788541083.610882:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788541083.610888:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968469504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.610925:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968469504:12345-0@lo:400:kworker.0 Request processed in 36us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.610931:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788541083.610943:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788541083.610948:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968469120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.610975:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968469120:12345-0@lo:400:kworker.0 Request processed in 27us (2785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.611001:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788541083.611012:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788541083.611017:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968469248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.611041:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968469248:12345-0@lo:400:kworker.0 Request processed in 25us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.611046:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788541083.611073:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541083.611078:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541083.611282:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adfe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968468992:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.611299:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adfe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968469504:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.611310:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adfe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968469376:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.611355:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adfe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968469248:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.611365:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adfe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968469120:0@lo:400:kworker.0 00000100:00100000:0.0:1788541083.611374:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788541083.611378:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff98d7bf4c4380, transno 4294967322 00000004:00080000:0.0:1788541083.611391:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788541083.612917:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968469632:0@lo:400:kworker.0 00000100:00100000:3.0:1788541084.132730:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541084.147051:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d78386c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968469760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541084.147127:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541084.147283:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469760 00000100:00100000:2.0:1788541084.147292:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469760 00000100:00100000:2.0:1788541084.147348:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788541084.147359:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968469760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541084.147396:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541084.147469:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968469760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541084.147487:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788541084.147634:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d78386c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968469760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788541084.247589:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541084.652673:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541084.652889:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945418496 00000100:00100000:0.0:1788541084.652900:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945418496 00000100:00100000:0.0:1788541084.652990:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 238 00000100:00100000:0.0:1788541084.653002:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6828ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:11294:x1875420945418496:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788541084.653122:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6828ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:11294:x1875420945418496:12345-192.168.202.59@tcp:60:lhsmtool_posix.0 Request processed in 123us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541084.653149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 238 00000100:00080000:2.0:1788541084.653229:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541084.658873:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541084.659790:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945418752 00000100:00100000:0.0:1788541084.659805:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945418752 00000100:00100000:0.0:1788541084.659887:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:0.0:1788541084.659898:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+18:11294:x1875420945418752:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541084.660455:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+19:11294:x1875420945418752:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 513us (1547us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788541084.660464:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 65 00000100:00100000:3.0:1788541085.126951:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541085.127087:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945418880 00000100:00100000:0.0:1788541085.127108:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945418880 00000100:00100000:0.0:1788541085.127201:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 239 00000100:00100000:0.0:1788541085.127211:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+5:12092:x1875420945418880:12345-192.168.202.59@tcp:101:lsof.0 00010000:00010000:0.0:1788541085.127232:0:9724:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541085.127256:0:9724:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ba24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1978 expref: -99 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541085.127323:0:9724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1ba2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541085.127340:0:9724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1ba2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541085.127356:0:9724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1ba2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541085.127395:0:9724:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788541085.127399:0:9724:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541085.127504:0:9724:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1ba2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9724 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541085.127528:0:9724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7800/0xc9a6a13d3cd1ba24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1978 expref: 7 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541085.127548:0:9724:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1ba2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1978 expref: 6 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541085.127557:0:9724:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:0.0:1788541085.127560:0:9724:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541085.127564:0:9724:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7600, rc 0) 00000100:00100000:0.0:1788541085.127616:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+6:12092:x1875420945418880:12345-192.168.202.59@tcp:101:lsof.0 Request processed in 407us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541085.127624:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 239 00000100:00080000:2.0:1788541085.127869:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541085.272659:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541086.295639:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788541086.726405:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788541086.726527:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788541086.726594:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788541086.726606:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788541086.850479:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541086.850524:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541086.850562:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541086.850587:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541086.850615:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541086.850643:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419392 00000100:00100000:3.0:1788541086.850652:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419392 00000100:00100000:3.0:1788541086.850704:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419264 00000100:00100000:3.0:1788541086.850707:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419264 00000100:00100000:3.0:1788541086.850728:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:3.0:1788541086.850739:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2361:x1875420945419392:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541086.850843:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+7:2361:x1875420945419392:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541086.850851:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:3.0:1788541086.850868:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:3.0:1788541086.850876:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2361:x1875420945419264:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541086.850916:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:103c367e-0a85-454e-8289-79a7b521f7f2+5:2361:x1875420945419264:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 42us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541086.850922:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:3.0:1788541086.850941:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419136 00000100:00100000:3.0:1788541086.850945:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419136 00000100:00100000:3.0:1788541086.850981:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419520 00000100:00100000:3.0:1788541086.850985:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419520 00000100:00100000:3.0:1788541086.850999:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 162 00000100:00100000:3.0:1788541086.851006:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+18:2361:x1875420945419136:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541086.851038:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:103c367e-0a85-454e-8289-79a7b521f7f2+18:2361:x1875420945419136:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 33us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541086.851045:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 162 00000100:00100000:3.0:1788541086.851056:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 163 00000100:00100000:3.0:1788541086.851061:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+6:2361:x1875420945419520:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541086.851080:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d9af4bce-162d-4333-8def-621043259a82+6:2361:x1875420945419520:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 19us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541086.851085:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 163 00000100:00080000:3.0:1788541086.851099:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541086.851103:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541086.851105:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541086.851618:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419008 00000100:00100000:2.0:1788541086.851624:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419008 00000100:00100000:2.0:1788541086.851661:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 301 00000100:00100000:2.0:1788541086.851669:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945419008:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541086.851721:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2361:x1875420945419008:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 53us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.851728:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 301 00010000:00010000:2.0:1788541087.319717:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541087.704555:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968469888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541087.704629:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541087.704862:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968469888 00000100:00100000:3.0:1788541087.704871:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968469888 00000100:00080000:2.0:1788541087.705053:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541087.705452:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788541087.705465:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968469888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541087.705512:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541087.705577:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968469888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.705599:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788541087.705691:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968469888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788541088.346728:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541088.728802:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968470144:0@lo:400:kworker.0 00000100:00100000:3.0:1788541088.728875:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.728926:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d784c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968470656:0@lo:400:kworker.0 00000100:00100000:3.0:1788541088.728949:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.728981:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541088.728987:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968470272:0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729089:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968470400:0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729118:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.729143:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788541088.729148:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968470016:0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729173:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.729192:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968470528:0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729211:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.729242:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470656 00000100:00100000:0.0:1788541088.729258:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470656 00000100:00100000:0.0:1788541088.729316:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470400 00000100:00100000:0.0:1788541088.729320:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470400 00000100:00100000:0.0:1788541088.729343:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541088.729352:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968470656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729402:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968470656:12345-0@lo:400:kworker.0 Request processed in 51us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541088.729429:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541088.729456:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541088.729462:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968470400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729496:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968470400:12345-0@lo:400:kworker.0 Request processed in 33us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541088.729501:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541088.729518:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470016 00000100:00100000:0.0:1788541088.729521:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470016 00000100:00100000:0.0:1788541088.729543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788541088.729549:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968470016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729575:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968470016:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541088.729581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788541088.729607:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470144 00000100:00100000:0.0:1788541088.729611:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470144 00000100:00100000:0.0:1788541088.729630:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470528 00000100:00100000:0.0:1788541088.729633:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470528 00000100:00100000:0.0:1788541088.729650:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788541088.729655:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968470144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729682:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968470144:12345-0@lo:400:kworker.0 Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541088.729694:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788541088.729705:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788541088.729710:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968470528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729733:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968470528:12345-0@lo:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541088.729738:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1788541088.729751:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541088.729755:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541088.729802:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968470016:0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729816:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968470528:0@lo:400:kworker.0 00000100:00100000:0.0:1788541088.729823:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968470400:0@lo:400:kworker.0 00000100:00100000:3.0:1788541088.729973:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.730082:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968470144:0@lo:400:kworker.0 00000100:00100000:3.0:1788541088.730093:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d784c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968470656:0@lo:400:kworker.0 00000100:00100000:3.0:1788541088.730117:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470272 00000100:00100000:3.0:1788541088.730121:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470272 00000100:00100000:3.0:1788541088.730147:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788541088.730153:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541088.730187:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968470272:12345-0@lo:400:kworker.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.730193:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788541088.730221:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968470272:0@lo:400:kworker.0 00000100:00080000:0.0:1788541088.730348:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788541088.769870:0:12833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:58:07 (1788541087) 00000100:00100000:1.0:1788541089.240658:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968470784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541089.240738:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541089.240945:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470784 00000100:00100000:2.0:1788541089.240953:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470784 00000100:00100000:2.0:1788541089.241007:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541089.241019:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968470784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541089.241066:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541089.241122:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968470784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541089.241130:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788541089.241387:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968470784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788541089.370892:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541090.402857:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541091.415732:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541091.963521:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541091.963579:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541091.963621:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541091.963643:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541091.963675:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541091.963706:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945420032 00000100:00100000:1.0:1788541091.963715:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945420032 00000100:00100000:1.0:1788541091.963783:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419904 00000100:00100000:1.0:1788541091.963786:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419904 00000100:00100000:1.0:1788541091.963811:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:1.0:1788541091.963820:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945420032:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541091.963891:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2360:x1875420945420032:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 72us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541091.963898:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:1.0:1788541091.963915:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:1.0:1788541091.963922:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945419904:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541091.963946:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681baaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2360:x1875420945419904:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541091.963953:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:1.0:1788541091.963971:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419776 00000100:00100000:1.0:1788541091.963975:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419776 00000100:00100000:1.0:1788541091.964001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945420160 00000100:00100000:1.0:1788541091.964005:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945420160 00000100:00100000:1.0:1788541091.964025:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:1.0:1788541091.964046:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+18:2360:x1875420945419776:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541091.964074:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681ba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+18:2360:x1875420945419776:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541091.964080:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 167 00000100:00100000:1.0:1788541091.964091:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00100000:1.0:1788541091.964097:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+6:2360:x1875420945420160:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541091.964117:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d9af4bce-162d-4333-8def-621043259a82+6:2360:x1875420945420160:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 20us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541091.964122:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 168 00000100:00080000:1.0:1788541091.964136:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541091.964140:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541091.964142:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541091.964601:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945419648 00000100:00100000:2.0:1788541091.964607:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945419648 00000100:00100000:2.0:1788541091.964647:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 303 00000100:00100000:2.0:1788541091.964654:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945419648:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541091.964690:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945419648:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 36us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541091.964696:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 303 00010000:00010000:0.0:1788541092.439581:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541092.752476:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541092.752549:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945420416 00000100:00100000:2.0:1788541092.752558:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945420416 00000100:00100000:2.0:1788541092.752609:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:2.0:1788541092.752617:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+18:12313:x1875420945420416:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:2.0:1788541092.753165:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:12313:x1875420945420416:12345-192.168.202.59@tcp:35:umount.0 Request processed in 546us (695us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788541092.753175:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 66 00000100:00100000:2.0:1788541092.760481:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541092.761028:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945420672 00000100:00100000:0.0:1788541092.761040:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945420672 00000100:00100000:0.0:1788541092.761106:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:0.0:1788541092.761118:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+19:12313:x1875420945420672:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:0.0:1788541092.761525:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:12313:x1875420945420672:12345-192.168.202.59@tcp:35:umount.0 Request processed in 407us (1053us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788541092.761533:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 67 00000100:00100000:1.0:1788541092.767807:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541092.767921:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945420928 00000100:00100000:0.0:1788541092.767931:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945420928 00000100:00100000:0.0:1788541092.768031:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:0.0:1788541092.768041:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a36a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+20:12313:x1875420945420928:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:0.0:1788541092.768301:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a36a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:103c367e-0a85-454e-8289-79a7b521f7f2+21:12313:x1875420945420928:12345-192.168.202.59@tcp:35:umount.0 Request processed in 260us (506us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788541092.768309:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 68 00000100:00100000:1.0:1788541092.784782:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541092.786929:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945421184 00000100:00100000:3.0:1788541092.786946:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945421184 00000100:00100000:3.0:1788541092.787025:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:3.0:1788541092.787036:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+21:12313:x1875420945421184:12345-192.168.202.59@tcp:35:umount.0 00000100:00100000:3.0:1788541092.787775:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:103c367e-0a85-454e-8289-79a7b521f7f2+22:12313:x1875420945421184:12345-192.168.202.59@tcp:35:umount.0 Request processed in 737us (2999us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788541092.787785:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 69 00000100:00100000:2.0:1788541092.798300:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541092.798465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945421312 00000100:00100000:3.0:1788541092.798476:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945421312 00000100:00100000:3.0:1788541092.798554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:3.0:1788541092.798566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2360:x1875420945421312:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541092.798585:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541092.798605:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bc800/0xc9a6a13d3cd1aa41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1503 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.798623:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541092.798689:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2360:x1875420945421312:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 125us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541092.798697:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:1.0:1788541092.802368:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541092.802454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541092.802535:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541092.802646:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945421696 00000100:00100000:0.0:1788541092.802656:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945421696 00000100:00100000:0.0:1788541092.802712:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 73 00000100:00100000:0.0:1788541092.802721:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2357:x1875420945421696:12345-192.168.202.59@tcp:9:umount.0 00000020:00000080:0.0:1788541092.802763:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1afdc 00000020:00010000:0.0:1788541092.802771:0:6706:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d786464000: total 0 00000100:00080000:0.0:1788541092.802776:0:6706:0:(import.c:65:import_set_state_nolock()) ffff98d786467000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541092.802813:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788541092.803099:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:103c367e-0a85-454e-8289-79a7b521f7f2+5:2357:x1875420945421696:12345-192.168.202.59@tcp:9:umount.0 Request processed in 378us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.803107:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 73 00000020:00010000:0.0:1788541092.803130:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d786464000: total 0 00010000:00010000:0.0:1788541092.803150:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d786464000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788541092.803201:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018653b16/0xc9a6a13d3cd1ba1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1971 expref: 4 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541092.803237:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002db1262c/0xc9a6a13d3cd1b37f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17a3 expref: 3 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541092.803252:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d786464000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788541092.803263:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541092.803265:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541092.803267:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541092.805712:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945421824 00000100:00100000:2.0:1788541092.805727:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945421824 00000100:00100000:2.0:1788541092.805808:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945421952 00000100:00100000:2.0:1788541092.805811:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945421952 00000100:00100000:2.0:1788541092.805838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1788541092.805847:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+13:2358:x1875420945421824:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541092.805864:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541092.805883:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1acb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15ce expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541092.805901:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541092.805973:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2358:x1875420945421824:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 127us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541092.805990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1788541092.806012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:2.0:1788541092.806018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:2361:x1875420945421952:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541092.806026:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541092.806035:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fce00/0xc9a6a13d3cd1aa09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac14cb expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541092.806044:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541092.806073:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2361:x1875420945421952:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 55us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541092.806079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:0.0:1788541092.808062:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541092.808342:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945422080 00000100:00100000:3.0:1788541092.808351:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945422080 00000100:00100000:3.0:1788541092.808613:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:3.0:1788541092.808627:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+5:2357:x1875420945422080:12345-192.168.202.59@tcp:9:umount.0 00000020:00000080:3.0:1788541092.808662:0:6704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1ad7b 00000100:00080000:3.0:1788541092.808675:0:6704:0:(import.c:65:import_set_state_nolock()) ffff98d7bf5d5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541092.808721:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788541092.809133:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:103c367e-0a85-454e-8289-79a7b521f7f2+2:2357:x1875420945422080:12345-192.168.202.59@tcp:9:umount.0 Request processed in 509us (1078us total) trans 0 rc 0/0 00010000:00010000:1.0:1788541092.809185:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541092.819158:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:2.0:1788541092.821043:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541092.821144:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945423104 00000100:00100000:1.0:1788541092.821154:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945423104 00000100:00100000:1.0:1788541092.821218:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 240 00000100:00100000:1.0:1788541092.821228:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+22:2357:x1875420945423104:12345-192.168.202.59@tcp:39:umount.0 00000020:00000080:1.0:1788541092.821264:0:5852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1aa17 00000020:00010000:1.0:1788541092.821290:0:5852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d7ae096800: total 0 00000100:00080000:1.0:1788541092.821295:0:5852:0:(import.c:65:import_set_state_nolock()) ffff98d7ae097000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541092.821341:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788541092.821698:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d7ae096800: total 0 00010000:00010000:3.0:1788541092.821709:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541092.821760:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d7ae096800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788541092.821795:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541092.821799:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541092.821809:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1b6dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1898 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821831:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541092.821834:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541092.821838:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7400/0xc9a6a13d3cd1b03e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac16ca expref: 20 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821850:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d78b22b800) 00010000:00010000:3.0:1788541092.821853:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541092.821857:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6e00/0xc9a6a13d3cd1ace1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15dc expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821876:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff98d78b22ba00) 00010000:00010000:3.0:1788541092.821878:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788541092.821882:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6000/0xc9a6a13d3cd1b3fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17c6 expref: 18 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821894:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541092.821897:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541092.821901:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603a00/0xc9a6a13d3cd1b260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1756 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821912:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98d78320dd00) 00010000:00010000:3.0:1788541092.821914:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788541092.821924:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1ad51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15f8 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821943:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541092.821946:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541092.821949:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1b8fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1924 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821960:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d78320d200) 00010000:00010000:3.0:1788541092.821961:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541092.821965:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7813fd000/0xc9a6a13d3cd1acfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15e3 expref: 14 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821979:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541092.821981:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788541092.821984:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d780031c00/0xc9a6a13d3cd1b36a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac179c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.821996:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541092.821999:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541092.822002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603600/0xc9a6a13d3cd1b9de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac195c expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.822012:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:3.0:1788541092.822015:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541092.822018:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cde00/0xc9a6a13d3cd1b3e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac17bf expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.822029:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff98d786553000) 00010000:00010000:3.0:1788541092.822037:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788541092.822041:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f6400/0xc9a6a13d3cd1ba08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac196a expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.822057:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff98d786553d00) 00010000:00010000:3.0:1788541092.822059:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541092.822062:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603200/0xc9a6a13d3cd1b340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac178e expref: 9 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541092.822074:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d7ae096800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788541092.822086:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541092.822088:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541092.822089:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541092.822840:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:103c367e-0a85-454e-8289-79a7b521f7f2+7:2357:x1875420945423104:12345-192.168.202.59@tcp:39:umount.0 Request processed in 1608us (1802us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788541092.822851:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 240 00000100:00100000:2.0:1788541092.824367:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541092.824391:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968470912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541092.824493:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541092.824782:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968470912 00000100:00100000:3.0:1788541092.824790:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968470912 00000100:00100000:3.0:1788541092.824855:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788541092.824867:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968470912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541092.824908:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541092.824973:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968470912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (479us total) trans 0 rc 0/0 00000100:00080000:1.0:1788541092.825058:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541092.825147:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788541092.825470:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968470912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788541093.464823:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541093.783683:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788541093.783694:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541093.784225:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788541093.784234:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788541093.847921:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968471168:0@lo:400:kworker.0 00000100:00100000:3.0:1788541093.847997:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541093.848065:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968471680:0@lo:400:kworker.0 00000100:00100000:3.0:1788541093.848106:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541093.848137:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541093.848143:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968471296:0@lo:400:kworker.0 00000100:00100000:3.0:1788541093.848179:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541093.848225:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471168 00000100:00100000:1.0:1788541093.848560:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968471424:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.848591:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541093.848612:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788541093.848617:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968471040:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.848643:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541093.848663:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968471552:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.848681:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541093.848704:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471040 00000100:00100000:1.0:1788541093.848707:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471040 00000100:00100000:1.0:1788541093.848781:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788541093.848791:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968471040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.848839:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968471040:12345-0@lo:400:kworker.0 Request processed in 50us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541093.848846:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788541093.848879:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471680 00000100:00100000:1.0:1788541093.848882:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471680 00000100:00100000:1.0:1788541093.848913:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471424 00000100:00100000:1.0:1788541093.848916:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471424 00000100:00100000:1.0:1788541093.848934:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788541093.848940:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968471680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.848988:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968471680:12345-0@lo:400:kworker.0 Request processed in 48us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541093.849002:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788541093.849014:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788541093.849020:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968471424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849047:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968471424:12345-0@lo:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541093.849052:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788541093.849068:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541093.849095:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968471040:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849107:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968471424:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849136:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968471680:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849149:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471296 00000100:00100000:1.0:1788541093.849153:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471296 00000100:00100000:1.0:1788541093.849177:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471552 00000100:00100000:1.0:1788541093.849180:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471552 00000100:00100000:1.0:1788541093.849194:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788541093.849200:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968471296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849234:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968471296:12345-0@lo:400:kworker.0 Request processed in 35us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541093.849239:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788541093.849250:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788541093.849256:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968471552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849295:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875420968471552:12345-0@lo:400:kworker.0 Request processed in 40us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541093.849301:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1788541093.849318:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541093.849332:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1875420968471552:0@lo:400:kworker.0 00000100:00100000:1.0:1788541093.849350:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968471296:0@lo:400:kworker.0 00000100:00100000:3.0:1788541093.849614:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471168 00000100:00100000:3.0:1788541093.849651:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788541093.849659:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968471168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541093.849708:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968471168:12345-0@lo:400:kworker.0 Request processed in 50us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541093.849714:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788541093.849793:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968471168:0@lo:400:kworker.0 00000100:00100000:1.0:1788541094.360359:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541094.360471:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541094.360669:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471808 00000100:00100000:2.0:1788541094.360676:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471808 00000100:00100000:2.0:1788541094.360725:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788541094.360762:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541094.360798:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541094.360849:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541094.360856:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788541094.361620:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968471808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788541094.488296:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541095.294545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541095.294593:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541095.294621:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541095.294651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541095.294682:0:9724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945423744 00000100:00100000:1.0:1788541095.294692:0:9724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945423744 00000100:00100000:1.0:1788541095.294768:0:9724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 241 00000100:00100000:1.0:1788541095.294778:0:9724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+6:2357:x1875420945423744:12345-192.168.202.59@tcp:39:umount.0 00000020:00000080:1.0:1788541095.294816:0:9724:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1aafe 00000020:00010000:1.0:1788541095.294825:0:9724:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d7b5261000: total 0 00000100:00080000:1.0:1788541095.294830:0:9724:0:(import.c:65:import_set_state_nolock()) ffff98d7b5262000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541095.294852:0:9724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788541095.295062:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945423232 00000100:00100000:2.0:1788541095.295067:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945423232 00000100:00100000:2.0:1788541095.295099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945423488 00000100:00100000:2.0:1788541095.295102:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945423488 00000100:00100000:2.0:1788541095.295115:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945423360 00000100:00100000:2.0:1788541095.295118:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945423360 00000100:00100000:2.0:1788541095.295132:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541095.295138:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+12:2358:x1875420945423232:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541095.295150:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541095.295168:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fda00/0xc9a6a13d3cd1aae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1518 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541095.295203:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541095.295265:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+11:2358:x1875420945423232:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 115us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541095.295272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541095.295293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1788541095.295299:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+10:2358:x1875420945423488:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541095.295309:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541095.295319:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7912f7000/0xc9a6a13d3cd1acb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac15c7 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541095.295328:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541095.295346:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+9:2358:x1875420945423488:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 47us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541095.295352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1788541095.295392:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1788541095.295399:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+8:2358:x1875420945423360:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541095.295452:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541095.295462:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1aaf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1542 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541095.295471:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541095.295489:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:43ec13c5-96bd-48c4-8b44-93641d70bc35+7:2358:x1875420945423360:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 90us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541095.295496:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00080000:2.0:1788541095.295651:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788541095.295678:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d7b5261000: total 0 00010000:00010000:2.0:1788541095.295730:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d7b5261000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788541095.295756:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d000) 00010000:00010000:2.0:1788541095.295759:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541095.295765:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7912f7600/0xc9a6a13d3cd1ba2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1978 expref: 5 pid: 9724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541095.295789:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d7b5261000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788541095.295799:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541095.295801:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541095.295803:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541095.296294:0:9724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d9af4bce-162d-4333-8def-621043259a82+3:2357:x1875420945423744:12345-192.168.202.59@tcp:39:umount.0 Request processed in 1515us (1639us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788541095.296303:0:9724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 241 00000100:00100000:1.0:1788541095.317363:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541095.317602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424000 00000100:00100000:0.0:1788541095.317616:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424000 00000100:00100000:0.0:1788541095.317679:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 305 00000100:00100000:0.0:1788541095.317689:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+7:2357:x1875420945424000:12345-192.168.202.59@tcp:251:umount.0 00000020:00000080:0.0:1788541095.317745:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a9f4 00000020:00010000:0.0:1788541095.317754:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d681ffd000: total 0 00000100:00080000:0.0:1788541095.317759:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98d681ffb800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788541095.317838:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78965ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:43ec13c5-96bd-48c4-8b44-93641d70bc35+3:2357:x1875420945424000:12345-192.168.202.59@tcp:251:umount.0 Request processed in 151us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541095.317846:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 305 00000020:00010000:3.0:1788541095.318105:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d681ffd000: total 0 00010000:00010000:3.0:1788541095.318110:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541095.318152:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d681ffd000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788541095.318201:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bda00/0xc9a6a13d3cd1aa48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac150a expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541095.318215:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d681ffd000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788541095.318223:0:5839:0:(genops.c:885:class_export_put()) final put ffff98d681ffd000/43ec13c5-96bd-48c4-8b44-93641d70bc35 00010000:00010000:3.0:1788541095.318240:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541095.318242:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541095.318244:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788541095.319004:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d681ffd000/43ec13c5-96bd-48c4-8b44-93641d70bc35 for MGS 00000020:00000080:0.0:1788541095.319049:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d681ffb800 for MGS 00010000:00010000:2.0:1788541095.511697:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541096.538198:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788541097.009833:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1788541097.009851:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d9af4bce-162d-4333-8def-621043259a82 00000001:00080000:3.0:1788541097.009856:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788541097.009859:0:5872:0:(genops.c:885:class_export_put()) final put ffff98d7b5261000/d9af4bce-162d-4333-8def-621043259a82 00000001:00100000:3.0:1788541097.009881:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000001:00080000:3.0:1788541097.009885:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788541097.009899:0:5872:0:(genops.c:885:class_export_put()) final put ffff98d7ae096800/103c367e-0a85-454e-8289-79a7b521f7f2 00000001:00100000:3.0:1788541097.010045:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:3.0:1788541097.010049:0:6732:0:(genops.c:885:class_export_put()) final put ffff98d7bf5d4000/103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:1.0:1788541097.010827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7b5261000/d9af4bce-162d-4333-8def-621043259a82 for lustre-MDT0000 00000020:00000080:1.0:1788541097.019340:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae096800/103c367e-0a85-454e-8289-79a7b521f7f2 for lustre-MDT0000 00000020:00000080:1.0:1788541097.019396:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf5d4000/103c367e-0a85-454e-8289-79a7b521f7f2 for lustre-OST0000 00000020:00000080:1.0:1788541097.019442:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7b5262000 for lustre-MDT0000 00000020:00000080:1.0:1788541097.019447:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7ae097000 for lustre-MDT0000 00000020:00000080:1.0:1788541097.019450:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7bf5d5800 for lustre-OST0000 00000001:00100000:1.0:1788541097.047189:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:1.0:1788541097.047199:0:7660:0:(genops.c:885:class_export_put()) final put ffff98d786464000/103c367e-0a85-454e-8289-79a7b521f7f2 00000020:00000080:2.0:1788541097.049579:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d786464000/103c367e-0a85-454e-8289-79a7b521f7f2 for lustre-OST0001 00000020:00000080:3.0:1788541097.049760:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d786467000 for lustre-OST0001 00000020:01000004:1.0:1788541097.074233:0:13030:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788541097.091187:0:13030:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788541097.091233:0:13030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.091246:0:13030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.091254:0:13030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.091262:0:13030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.091577:0:13030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788541097.091583:0:13030:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788541097.091605:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541097.091610:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788541097.091615:0:13030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788541097.091639:0:13030:0:(import.c:65:import_set_state_nolock()) ffff98d7ad285000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788541097.092214:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968471936:0@lo:39:umount.0 00000100:00100000:0.0:1788541097.092286:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541097.092383:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968471936 00000100:00100000:3.0:1788541097.092390:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968471936 00000100:00100000:3.0:1788541097.092463:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788541097.092472:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d78386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875420968471936:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788541097.092512:0:5850:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a803 00000100:00080000:3.0:1788541097.092520:0:5850:0:(import.c:65:import_set_state_nolock()) ffff98d7ae243800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788541097.093098:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541097.093107:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.093116:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788541097.093121:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.093130:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541097.094964:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541097.094982:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541097.094984:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788541097.094987:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788541097.095031:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.095038:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788541097.095100:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968472064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541097.095162:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541097.095225:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.095234:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bc600/0xc9a6a13d3cd1aa87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.095262:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541097.095264:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541097.095267:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541097.095504:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d78386c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1875420968471936:12345-0@lo:39:umount.0 Request processed in 3031us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.095514:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788541097.095527:0:5850:0:(genops.c:885:class_export_put()) final put ffff98d7ae245000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788541097.095558:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae245000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541097.095603:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7ae243800 for lustre-MDT0000 00000100:00080000:3.0:1788541097.095640:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7ad285000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788541097.095652:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968471936:0@lo:39:umount.0 00000100:00080000:3.0:1788541097.095678:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541097.095681:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788541097.095685:0:13030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788541097.096472:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472064 00000100:00100000:1.0:1788541097.096480:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472064 00000100:00100000:1.0:1788541097.096531:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788541097.096540:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+19:3316:x1875420968472064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541097.096553:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541097.096568:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fc600/0xc9a6a13d3cd1aa8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa87 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.096583:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541097.097027:0:13030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097038:0:13030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097045:0:13030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097052:0:13030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097067:0:13030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541097.097073:0:13030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097096:0:13030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097102:0:13030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097108:0:13030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097115:0:13030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541097.097120:0:13030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097127:0:13030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097132:0:13030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097138:0:13030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097144:0:13030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788541097.097149:0:13030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097155:0:13030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097171:0:13030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097177:0:13030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541097.097185:0:13030:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788541097.097188:0:13030:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788541097.097208:0:13030:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788541097.097213:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788541097.097216:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541097.097221:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788541097.097225:0:13030:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98d7899d6800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788541097.097231:0:13030:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff98d7bf6d9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788541097.097236:0:13030:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff98d7b2f74d40) has exports, disconnecting them 00000020:00080000:3.0:1788541097.097240:0:13030:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98d7899d6800), last request at 1788541093 00000020:00000080:3.0:1788541097.097246:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a976 00000100:00080000:3.0:1788541097.097261:0:13030:0:(import.c:65:import_set_state_nolock()) ffff98d7899d1800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788541097.097299:0:13030:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d7899d6800): rc 0 00000020:00000080:3.0:1788541097.097302:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7899d6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788541097.097312:0:13030:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff98d7bf6d9000), last request at 1788541093 00000020:00000080:3.0:1788541097.097315:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a8ab 00000100:00080000:3.0:1788541097.097319:0:13030:0:(import.c:65:import_set_state_nolock()) ffff98d7bf6da800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788541097.097328:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7899d6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541097.097359:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7899d1800 for lustre-MDT0000 00000020:00080000:3.0:1788541097.097373:0:13030:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d7bf6d9000): rc 0 00000020:00000080:3.0:1788541097.097375:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7bf6d9000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788541097.097391:0:13030:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb64401547ae0 00000020:00000080:3.0:1788541097.097401:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf6d9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541097.097449:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7bf6da800 for lustre-MDT0000 00000100:00080000:3.0:1788541097.097472:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788541097.097475:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788541097.097486:0:13030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788541097.097550:0:13030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788541097.097565:0:13030:0:(import.c:65:import_set_state_nolock()) ffff98d7831fa800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788541097.097580:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788541097.097582:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788541097.097590:0:13030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541097.097658:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968472192:0@lo:9:umount.0 00000100:00100000:3.0:1788541097.097713:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541097.097756:0:13030:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788541097.097766:0:13030:0:(import.c:65:import_set_state_nolock()) ffff98d7ae090000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788541097.097782:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968472320:0@lo:9:umount.0 00000100:00100000:3.0:1788541097.097806:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788541097.097853:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98d7b2f74d40) has no exports 00010000:00010000:0.0:1788541097.098014:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788541097.098022:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.098029:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc400 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541097.098033:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.098042:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541097.098049:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541097.098062:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541097.098065:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788541097.098067:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788541097.098089:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.098095:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788541097.098391:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3316:x1875420968472064:12345-0@lo:103:ldlm_bl.0 Request processed in 1851us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541097.098400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788541097.098458:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472192 00000100:00100000:1.0:1788541097.098464:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472192 00000100:00100000:1.0:1788541097.098506:0:9248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472320 00000100:00100000:1.0:1788541097.098509:0:9248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472320 00000100:00100000:1.0:1788541097.098529:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788541097.098536:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875420968472192:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788541097.098556:0:9248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a8f8 00000100:00080000:1.0:1788541097.098562:0:9248:0:(import.c:65:import_set_state_nolock()) ffff98d7831fb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541097.098584:0:9248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788541097.098969:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3313:x1875420968472192:12345-0@lo:9:umount.0 Request processed in 432us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541097.098977:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788541097.098999:0:9248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788541097.099006:0:9248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d784c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875420968472320:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788541097.099018:0:9248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a9e6 00000100:00080000:1.0:1788541097.099023:0:9248:0:(import.c:65:import_set_state_nolock()) ffff98d7bf57c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541097.099035:0:9248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788541097.099204:0:9248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d784c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3313:x1875420968472320:12345-0@lo:9:umount.0 Request processed in 199us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541097.099211:0:9248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788541097.099235:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968472448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541097.099264:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541097.099355:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472448 00000100:00100000:1.0:1788541097.099360:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472448 00000100:00100000:1.0:1788541097.099387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541097.099393:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3317:x1875420968472448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541097.099403:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541097.099446:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1aa9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa95 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541097.099459:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541097.099485:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3317:x1875420968472448:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541097.099491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541097.099524:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968472448:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788541097.099552:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7ae090000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788541097.099559:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788541097.099561:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788541097.099563:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968472320:0@lo:9:umount.0 00000100:00080000:1.0:1788541097.099582:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7831fa800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788541097.099590:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788541097.099592:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788541097.099594:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968472192:0@lo:9:umount.0 00010000:00010000:1.0:1788541097.099618:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00080000:3.0:1788541097.099834:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541097.099838:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788541097.100118:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100128:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bc400/0xc9a6a13d3cd1aa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa9c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100139:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541097.100144:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100150:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7c00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541097.100154:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100161:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541097.100168:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541097.100174:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788541097.100177:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788541097.100180:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788541097.100208:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100214:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541097.100241:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100248:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7912f7c00/0xc9a6a13d3cd1aca2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aca9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100257:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541097.100260:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100265:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bca00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541097.100268:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100274:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541097.100280:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541097.100284:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541097.100287:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788541097.100288:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788541097.100300:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100305:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541097.100311:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100323:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bca00/0xc9a6a13d3cd1a762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1a769 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.100335:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541097.100337:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541097.100338:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541097.100878:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968472576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541097.100942:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541097.100988:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541097.100995:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968472704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541097.101017:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541097.101120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472576 00000100:00100000:0.0:1788541097.101127:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472576 00000100:00100000:0.0:1788541097.101172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472704 00000100:00100000:0.0:1788541097.101176:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472704 00000100:00100000:0.0:1788541097.101197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541097.101205:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+18:3314:x1875420968472576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541097.101216:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541097.101228:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1aca9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aca2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101241:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541097.101273:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+17:3314:x1875420968472576:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541097.101279:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541097.101295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788541097.101301:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+16:3314:x1875420968472704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541097.101309:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541097.101317:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781679000/0xc9a6a13d3cd1a769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a762 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101326:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541097.101355:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3314:x1875420968472704:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541097.101361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541097.101446:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968472704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541097.101456:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c6c881b-c5d1-4767-bf18-6c64f558276e:3314:1875420968472576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541097.101586:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968472064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541097.101750:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541097.101753:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541097.101755:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541097.101783:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101792:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031400 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541097.101796:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101804:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541097.101812:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541097.101818:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541097.101821:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788541097.101823:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788541097.101845:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101851:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541097.101942:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101951:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031400/0xc9a6a13d3cd1a9ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1a9b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.101965:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541097.101967:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541097.101974:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541097.102006:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541097.102016:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968472832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541097.102045:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541097.102106:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968472832 00000100:00100000:0.0:1788541097.102111:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968472832 00000100:00100000:0.0:1788541097.102143:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541097.102149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+15:3317:x1875420968472832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541097.102157:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541097.102166:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7999bd800/0xc9a6a13d3cd1a9b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a9ae expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541097.102177:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541097.102202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c6c881b-c5d1-4767-bf18-6c64f558276e+14:3317:x1875420968472832:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541097.102208:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541097.102261:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968472832:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788541097.113585:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff98d7b2f74d40) has no exports 00000020:00000080:0.0:1788541097.175688:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a7bd 00000020:00000080:0.0:1788541097.175829:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae25f000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788541097.175853:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788541097.175947:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae25f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788541097.176330:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541097.176341:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788541097.176346:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff98d790104d40) has no exports 00000020:00000080:1.0:1788541097.178284:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a7b6 00000020:00000080:1.0:1788541097.178298:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7bc70d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788541097.178364:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541097.178375:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788541097.178378:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae226800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788541097.178381:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae226800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788541097.178393:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788541097.178489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bc70d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788541097.178834:0:13030:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d681357d80 - data ffff98d7b3c43d80/ffff98d681ef0800 00000020:01000000:1.0:1788541097.179056:0:13030:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d7b2cad780 - data ffff98d7821e0ca8/ffff98d7ad85d800 00000001:00000004:1.0:1788541097.192808:0:13030:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788541097.289619:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788541097.289628:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788541097.289651:0:13030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541097.289654:0:13030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788541097.289861:0:6853:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788541097.289867:0:6853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788541097.289877:0:6853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788541097.290941:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788541097.290947:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788541097.290959:0:13030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541097.290961:0:13030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788541097.291159:0:7936:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788541097.291164:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788541097.291173:0:7936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788541097.371519:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a785 00000020:00000080:0.0:1788541097.371531:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae245800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788541097.371568:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae245800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788541097.373790:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a79a 00000020:00000080:0.0:1788541097.373803:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae259800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788541097.373818:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788541097.373825:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.373834:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541097.373838:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff98d7b2f73380) has no exports 00000004:01000000:0.0:1788541097.374119:0:13030:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788541097.374127:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a9d8 00000020:00000080:0.0:1788541097.374131:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae094800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788541097.374135:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788541097.374139:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.374145:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788541097.374147:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff98d7ada7cd40) has no exports 00000020:00000080:0.0:1788541097.374153:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a9d1 00000020:00000080:0.0:1788541097.374156:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae097800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788541097.374681:0:13030:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788541097.374686:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788541097.374690:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788541097.374698:0:13030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788541097.374710:0:13030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541097.374740:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.374748:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541097.374754:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a8f1 00000020:00000080:0.0:1788541097.374759:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7831fb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788541097.374763:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788541097.374767:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.374770:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788541097.374772:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff98d7ae2519c0) has no exports 00000020:00000080:0.0:1788541097.374776:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a8ea 00000020:00000080:0.0:1788541097.374779:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7831f9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788541097.374859:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae259800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788541097.374867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae094800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788541097.374872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae097800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788541097.374877:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7ae090000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788541097.374882:0:8:0:(genops.c:885:class_export_put()) final put ffff98d7899d7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788541097.374884:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7899d7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788541097.374888:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788541097.374963:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7831fb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788541097.374967:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7831f9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788541097.375217:0:13030:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788541097.375221:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788541097.375223:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788541097.375226:0:13030:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788541097.375228:0:13030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541097.375451:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.375458:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541097.375480:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.375492:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541097.375495:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae242000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541097.375498:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae242000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788541097.375504:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541097.375654:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a7a1 00000020:00000080:0.0:1788541097.375659:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae258800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788541097.375763:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7831fa800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788541097.375770:0:8:0:(genops.c:885:class_export_put()) final put ffff98d7bf70e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788541097.375772:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf70e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788541097.375776:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788541097.375864:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788541097.375887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae258800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788541097.376032:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.376037:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788541097.376040:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff98d7ae253380) has no exports 00000020:00000080:0.0:1788541097.376061:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.376064:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788541097.376066:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae243000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788541097.376069:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae243000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788541097.376072:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788541097.376206:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a7a8 00000020:00000080:0.0:1788541097.376211:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae25d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788541097.376315:0:13030:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d782e54800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788541097.376319:0:13030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d782e54800 3 00000020:01000004:0.0:1788541097.376322:0:13030:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d782e54800 from lustre-MDT0000 00000020:00000080:0.0:1788541097.376341:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.376345:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788541097.376347:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ae240000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788541097.376349:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae240000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788541097.376356:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788541097.376378:0:13030:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788541097.376380:0:13030:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788541097.376383:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788541097.376385:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.376388:0:13030:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541097.376394:0:13030:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff98d7915b4800 6c6c881b-c5d1-4767-bf18-6c64f558276e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541097.376399:0:13030:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff98d7b2f719c0) has exports, disconnecting them 00000020:00080000:0.0:1788541097.376425:0:13030:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff98d7915b4800), last request at 1788540872 00000020:00000080:0.0:1788541097.376437:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a746 00000020:00010000:0.0:1788541097.376441:0:13030:0:(genops.c:1921:obd_stale_export_put()) Put export ffff98d7915b4800: total 1 00000100:00080000:0.0:1788541097.376445:0:13030:0:(import.c:65:import_set_state_nolock()) ffff98d7915b7000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541097.376460:0:13030:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d7915b4800): rc 0 00000020:00080000:0.0:1788541097.376464:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff98d7b2f719c0) has no exports 00000100:00100000:0.0:1788541097.376510:0:5843:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff98d790c36400:5843] 1 exiting: rc = 0 00000020:00000080:3.0:1788541097.376775:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ae25d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788541097.377479:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff98d7980ad000:5844] 2 exiting: rc = 0 00000100:00100000:1.0:1788541097.377986:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff98d7899eec00:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1788541097.378359:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378367:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378374:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378380:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378389:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378396:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378402:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378436:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378443:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378449:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378454:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378460:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378466:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378471:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378477:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378483:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378489:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378496:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378502:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378509:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378514:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378520:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378526:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378535:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378540:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378546:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378552:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378558:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378562:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378567:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378573:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378579:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378585:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378589:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378606:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378625:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378630:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378636:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378641:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378646:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378662:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378668:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378673:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378679:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378684:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378692:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378698:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378712:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378718:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378723:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378731:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378736:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378741:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378745:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378750:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378759:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378766:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378771:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:2.0:1788541097.378774:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff98d7915b4800: total 0 00000100:00100000:3.0:1788541097.378778:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378785:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378792:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378798:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378805:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.378813:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788541097.378828:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff98d7915b4800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788541097.378859:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7c2179e00/0xc9a6a13d3cd1ac9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ac94 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378886:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030c00/0xc9a6a13d3cd1a85e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1a857 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378901:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7813fc000/0xc9a6a13d3cd1aaaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aaa3 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378911:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1aa56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa4f expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378921:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d781679600/0xc9a6a13d3cd1aa64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa5d expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378931:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030400/0xc9a6a13d3cd1aa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa6b expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378940:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031a00/0xc9a6a13d3cd1aa80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1aa79 expref: 3 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378951:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7912f7a00/0xc9a6a13d3cd1ac8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ac86 expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541097.378961:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff98d7915b4800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788541097.378974:0:5839:0:(genops.c:885:class_export_put()) final put ffff98d7915b4800/6c6c881b-c5d1-4767-bf18-6c64f558276e 00010000:00010000:2.0:1788541097.379001:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541097.379004:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541097.379006:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788541097.379048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7915b4800/6c6c881b-c5d1-4767-bf18-6c64f558276e for MGS 00000020:00000080:0.0:1788541097.379093:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7915b7000 for MGS 20000000:01000000:0.0:1788541097.379305:0:13030:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788541097.379309:0:13030:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788541097.380917:0:13030:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d7bff3d5a0 - data ffff98d7bf914000/ffff98d6813f8800 00000020:01000000:0.0:1788541097.381044:0:13030:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d786314000 - data ffff98d7b0054438/ffff98d798056400 00000020:00000080:0.0:1788541097.381740:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a72a 00000020:00000080:0.0:1788541097.381751:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d782e50000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788541097.381802:0:13030:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d782e54800 from MGS, refs=2 00000020:01000004:0.0:1788541097.381806:0:13030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d782e54800 2 00000020:01000004:0.0:1788541097.381810:0:13030:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d782e54800 from MGS 00000020:00000080:0.0:1788541097.381831:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.381838:0:13030:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788541097.381841:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d782e54000/MGS 00000020:00000080:0.0:1788541097.381844:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d782e54000/MGS for MGS 00000020:01000000:0.0:1788541097.381850:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788541097.381901:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788541097.381905:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.381910:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541097.381916:0:13030:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff98d785875000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541097.381922:0:13030:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff98d7890619c0) has exports, disconnecting them 00000020:00080000:0.0:1788541097.381927:0:13030:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff98d785875000), last request at 1788540873 00000020:00000080:0.0:1788541097.381943:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a7f5 00000020:00080000:0.0:1788541097.381953:0:13030:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d785875000): rc 0 00000020:00000080:0.0:1788541097.381958:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d785875000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788541097.381982:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d782e50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788541097.383465:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d785875000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788541097.397306:0:13030:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788541097.397316:0:13030:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541097.397320:0:13030:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541097.397329:0:13030:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541097.397468:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7ad285000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788541097.397641:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541097.397695:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788541097.397711:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7ad281000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788541097.397715:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7ad281000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788541097.397724:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788541097.397792:0:13030:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d782e54800 1 00000020:00000080:0.0:1788541097.397799:0:13030:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a71c 00000020:00000080:0.0:1788541097.397805:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d782e56000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788541097.397849:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788541097.397854:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541097.397859:0:13030:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541097.397863:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff98d790103380) has no exports 00000020:00000080:3.0:1788541097.398839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff98d782e56000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788541097.490024:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541097.490039:0:13030:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788541097.490045:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d7885cd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788541097.490050:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7885cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788541097.490067:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788541097.490182:0:13030:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98d782e57800 00000020:01000000:2.0:1788541097.490201:0:13030:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788541097.490205:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541097.490209:0:13030:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788541097.490213:0:13030:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff98d789064d40) has no exports 00000100:00100000:2.0:1788541097.490312:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff98d786133600:5852] 2 exiting: rc = 0 00000100:00100000:3.0:1788541097.490751:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff98d78908c200:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1788541097.490849:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff98d786b8b600:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1788541097.491031:0:9724:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff98d7896fca00:9724] 3 exiting: rc = 0 00000100:00100000:2.0:1788541097.493181:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493190:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493197:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493202:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493208:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493215:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493221:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493227:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493232:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493382:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493392:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493398:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493403:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493435:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493442:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493448:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493453:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493458:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493465:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493472:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493478:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493485:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493490:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493496:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493502:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493507:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493513:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493538:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493544:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493549:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493556:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493562:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493567:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493573:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493578:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493583:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493588:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493607:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493614:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493620:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493625:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493629:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493635:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493641:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493646:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493651:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493656:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493661:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493666:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493671:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493679:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493684:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493689:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493695:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493712:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493719:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493725:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493730:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493736:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493741:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493746:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493751:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493766:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.493771:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.501057:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff98d786132000:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1788541097.502803:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff98d786133c00:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1788541097.502925:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502935:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502941:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502949:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502955:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502962:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502968:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502974:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502980:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502986:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.502992:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503000:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503008:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503013:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503018:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503023:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503028:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503034:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503039:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503044:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503049:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503054:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503059:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503063:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503068:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503073:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503078:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503083:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503088:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503093:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503099:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503124:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503128:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503134:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503139:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503143:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503147:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503152:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503157:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503161:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503165:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503170:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503174:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503179:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503184:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503188:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503192:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503198:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503202:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503206:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503211:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503216:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503221:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503225:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503230:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503235:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503251:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503261:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503266:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503271:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503276:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503281:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503286:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503291:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.503761:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff98d7980e9e00:5856] 1 exiting: rc = 0 00000100:00100000:2.0:1788541097.510721:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff98d7980e9400:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1788541097.512086:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512114:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512120:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512127:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512134:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512141:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512148:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512155:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512163:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512171:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512178:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512186:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512209:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512217:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512224:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512231:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512239:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512267:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512274:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512280:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512292:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512299:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512306:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512312:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512335:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512343:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512349:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512358:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512364:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512370:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512376:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512382:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512388:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512394:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512399:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512405:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512447:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512454:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512461:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512467:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512475:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512481:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512487:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512494:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512500:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512506:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512515:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512535:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512544:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512551:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512557:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512563:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512568:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512576:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512582:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512587:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512593:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512599:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512615:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512622:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512628:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512634:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512641:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.512655:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541097.527495:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff98d78909b600:5857] 0 exiting: rc = 1 00000100:00100000:3.0:1788541097.528159:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff98d78909b000:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1788541097.528287:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528296:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528302:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528307:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528313:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528318:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528322:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528328:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528332:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528336:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528342:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528347:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528352:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528357:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528362:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528367:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528371:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528376:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528381:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528387:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528392:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528398:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528403:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528435:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528441:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528447:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528452:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528456:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528461:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528466:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528470:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528476:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528496:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528501:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528508:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528514:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528519:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528524:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528530:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528535:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528540:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528545:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528550:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528554:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528559:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528564:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528569:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528573:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528578:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528583:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528588:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528594:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528600:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528605:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528610:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528616:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528621:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528625:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528631:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528636:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528642:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528647:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528652:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.528658:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.529631:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff98d78909b200:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1788541097.529752:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff98d78909a600:5859] 0 exiting: rc = 1 00000100:00100000:2.0:1788541097.530569:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530578:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530583:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530616:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530623:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530628:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530633:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530638:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530644:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530663:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530669:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530675:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530680:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530686:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530691:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530696:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530713:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530718:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530724:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530729:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530734:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530739:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530744:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530750:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530755:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530760:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530766:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530771:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530776:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530782:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530787:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530792:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530796:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530802:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530807:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530812:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530817:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530822:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530834:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530840:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530845:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530851:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530856:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530861:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530865:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530870:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530875:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530879:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530884:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530888:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530892:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530897:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530902:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530906:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530912:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530917:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530922:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530927:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530933:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530938:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530942:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.530947:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.531067:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.531077:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541097.538812:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff98d78909aa00:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1788541097.542557:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff98d78909a200:5862] 1 exiting: rc = 0 00000100:00100000:2.0:1788541097.542852:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542861:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542866:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542871:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542876:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542882:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542888:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542893:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542898:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542919:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542924:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542930:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542935:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542940:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542946:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.542950:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543340:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543345:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543350:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543355:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543360:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543365:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543370:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543375:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543380:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543386:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543391:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543397:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543402:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543433:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543440:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543445:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543451:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543456:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543462:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543467:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543473:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543478:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543484:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543490:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543495:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543500:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543506:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543512:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543527:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543532:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543537:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543543:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543549:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543553:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543559:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543564:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543570:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543575:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543581:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543586:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543590:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543609:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543614:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543620:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543625:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543631:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543636:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.543642:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541097.544726:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff98d78909bc00:5863] 0 exiting: rc = 1 00000100:00100000:0.0:1788541097.544854:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff98d7980efc00:5864] 1 exiting: rc = 0 00000100:00100000:0.0:1788541097.545104:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff98d7980ee000:5865] 2 exiting: rc = 0 00000100:00100000:2.0:1788541097.545941:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.545950:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546135:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546146:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546153:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546158:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546164:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546171:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546176:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546181:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546187:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546203:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546210:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546215:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546221:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546239:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546244:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546250:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546256:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546262:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546268:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546273:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546279:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546284:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546289:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546295:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546301:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546307:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546313:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546319:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546324:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546330:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546335:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546341:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546347:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546366:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546372:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546378:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546383:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546389:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546394:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546399:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546431:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546440:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546446:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546453:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546458:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546463:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546467:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546473:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546486:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546491:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546496:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546501:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546507:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546512:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546517:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546522:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546528:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546537:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546545:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546555:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546561:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541097.546568:0:13030:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788541097.562965:0:13030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541097.562980:0:13030:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788541097.562999:0:13030:0:(genops.c:885:class_export_put()) final put ffff98d786bf7000/MDS_uuid 00000020:00000080:3.0:1788541097.563004:0:13030:0:(genops.c:844:class_export_destroy()) destroying export ffff98d786bf7000/MDS_uuid for MDS 00000020:01000000:3.0:1788541097.563328:0:13030:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788541097.564884:0:13030:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788541097.565348:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541098.586496:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541098.969598:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541098.969636:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968472960:0@lo:400:kworker.0 00000100:00100000:1.0:1788541098.969636:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788541098.969831:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968473088:0@lo:400:kworker.0 00000400:00000100:1.0:1788541098.982278:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968473216 offset 0 length 224: 4 00000400:00000100:2.0:1788541098.985121:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420968472960 offset 0 length 224: 4 00000400:00000100:3.0:1788541098.985784:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968473088 offset 0 length 224: 4 00010000:00010000:1.0:1788541099.608586:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788541100.118892:0:13182:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788541100.134562:0:13182:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788541100.134614:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541100.134628:0:13182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541100.134634:0:13182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541100.134641:0:13182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541100.134663:0:13182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788541100.134668:0:13182:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788541100.134703:0:13182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541100.134718:0:13182:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d7adc28000 x1875420968473088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541100.134804:0:13182:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788541100.134812:0:13182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788541100.134839:0:13182:0:(import.c:65:import_set_state_nolock()) ffff98d7bf6d8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788541100.135033:0:13031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541100.135041:0:13031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541100.135060:0:13031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bce00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541100.135078:0:13031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541100.135087:0:13031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541100.135094:0:13031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541100.135100:0:13031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541100.135102:0:13031:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788541100.135105:0:13031:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788541100.135128:0:13031:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541100.135135:0:13031:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541100.135164:0:13031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541100.135171:0:13031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bce00/0xc9a6a13d3cd1aa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc9a6a13d3cd1aa72 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541100.135182:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541100.135184:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541100.135185:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541100.135259:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541100.135272:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968473472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541100.135342:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541100.135400:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968473472 00000100:00100000:0.0:1788541100.135426:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968473472 00000100:00100000:0.0:1788541100.135465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541100.135479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d790c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3317:x1875420968473472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788541100.135485:0:5837:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541100 with bad export cookie 14530478532142933830 00000100:00100000:2.0:1788541100.136048:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875420968473344:0@lo:39:umount.0 00000400:00000100:2.0:1788541100.136080:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968473344 offset 0 length 224: 4 00000100:00100000:1.0:1788541100.143037:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968473088:0@lo:400:kworker.0 00000100:00100000:0.0:1788541100.145710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d790c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3317:x1875420968473472:12345-0@lo:103:ldlm_bl.0 Request processed in 10221us (10358us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788541100.145726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788541100.146225:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788541100.146231:0:3317:0:(import.c:65:import_set_state_nolock()) ffff98d7b2f5b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788541100.146245:0:3317:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788541100.155389:0:3317:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.159@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788541100.155397:0:3317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788541100.155430:0:3317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d7adc29500 x1875420968472960/t0(0) o400->MGC192.168.202.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788541114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541100.155451:0:3317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d7bf4c5500 x1875420968473472/t0(0) o103->MGC192.168.202.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541116 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788541100.155460:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788541100.155464:0:3317:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788541100.155465:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788541100.155468:0:3317:0:(import.c:65:import_set_state_nolock()) ffff98d7b2f5b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788541100.155485:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c6c881b-c5d1-4767-bf18-6c64f558276e:3316:1875420968472960:0@lo:400:kworker.0 00000100:00080000:1.0:1788541100.157975:0:3317:0:(import.c:545:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 157 00000100:00080000:1.0:1788541100.157990:0:3317:0:(import.c:665:import_select_connection()) MGC192.168.202.159@tcp: import ffff98d7b2f5b800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1788541100.158277:0:3317:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d682925f80 x1875420968473600/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541100.158351:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c6c881b-c5d1-4767-bf18-6c64f558276e:3313:1875420968473600:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788541100.158434:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420968473600 offset 0 length 520: 4 00000100:00100000:2.0:1788541100.158568:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c6c881b-c5d1-4767-bf18-6c64f558276e:3317:1875420968473472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541100.631796:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541101.656207:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788541102.081245:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541102.081255:0:7660:0:(genops.c:885:class_export_put()) final put ffff98d7bf57f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541102.081284:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf57f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788541102.081326:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7bf57c800 for lustre-OST0001 00000001:00100000:1.0:1788541102.148489:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788541102.148498:0:6732:0:(genops.c:885:class_export_put()) final put ffff98d7831fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788541102.149046:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7831fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788541102.149099:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7831fb800 for lustre-OST0000 00010000:00010000:0.0:1788541102.679602:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541103.703639:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541104.088356:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541104.088367:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788541104.088498:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968473728:0@lo:400:kworker.0 00000400:00000100:2.0:1788541104.088574:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968473728 offset 0 length 224: 4 00010000:00010000:1.0:1788541104.728774:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541105.112803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541105.112812:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541105.112948:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968473856:0@lo:400:kworker.0 00000400:00000100:1.0:1788541105.113008:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968473856 offset 0 length 224: 4 00010000:00010000:0.0:1788541105.752059:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541106.775973:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541107.799750:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541108.823593:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541109.848394:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541110.232445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541110.232457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541110.232581:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541110.232616:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968473984:0@lo:400:kworker.0 00000400:00000100:1.0:1788541110.232695:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968473984 offset 0 length 224: 4 00000100:00100000:2.0:1788541110.743615:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541100/real 1788541100] req@ffff98d682925f80 x1875420968473600/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541110 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541110.743650:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d682925f80 x1875420968473600/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541110 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541110.743659:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541100/real 1788541100] req@ffff98d7b2f30380 x1875420968473344/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541110 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541110.743668:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d7b2f30380 x1875420968473344/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541110 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541110.743684:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b2f5b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541110.743697:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788541110.743700:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c6c881b-c5d1-4767-bf18-6c64f558276e:3313:1875420968473600:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788541110.743705:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7bf6d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788541110.743722:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875420968473344:0@lo:39:umount.0 00000100:00080000:3.0:1788541110.743863:0:13182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541110.743866:0:13182:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788541110.743870:0:13182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788541110.744360:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541110.744367:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788541110.744371:0:8:0:(import.c:65:import_set_state_nolock()) ffff98d7b2f5b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541110.744377:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 385 00000100:00080000:0.0:1788541110.744383:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.159@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541110.744391:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.159@tcp: import ffff98d7b2f5b800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788541110.744575:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bf4c7b80 x1875420968474112/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788541110.744703:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744713:0:13182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744718:0:13182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744723:0:13182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744737:0:13182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541110.744742:0:13182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744795:0:13182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744800:0:13182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744805:0:13182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541110.744805:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541110.744817:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541110.744823:0:13182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788541110.744830:0:13182:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1788541110.744830:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:1.0:1788541110.744835:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541110.744844:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541110.744854:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541110.744860:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:01000004:3.0:1788541110.744862:0:13182:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 10000000:01000000:1.0:1788541110.744863:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:01000000:3.0:1788541110.744866:0:13182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:01000000:1.0:1788541110.744868:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00000080:3.0:1788541110.744870:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541110.744875:0:13182:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541110.744879:0:13182:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98d7899499c0) has no exports 00010000:00010000:1.0:1788541110.744884:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:1.0:1788541110.744890:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541110.744897:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031800/0xc9a6a13d3cd1aa79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aa80 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788541110.744901:0:13182:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff98d7899499c0) has no exports 00010000:00010000:0.0:1788541110.744938:0:13031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541110.744944:0:13031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541110.744951:0:13031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602a00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541110.744962:0:13031:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541110.744970:0:13031:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541110.744976:0:13031:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541110.744982:0:13031:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788541110.744984:0:13031:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788541110.744986:0:13031:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788541110.744993:0:13031:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:0.0:1788541110.745008:0:13031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541110.745015:0:13031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1ac94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1ac9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541110.745031:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541110.745033:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541110.745035:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541110.745167:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541110.745170:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541110.745172:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541110.745662:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c6c881b-c5d1-4767-bf18-6c64f558276e:3313:1875420968474112:0@lo:250:kworker.0 00000400:00000100:2.0:1788541110.745716:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420968474112 offset 0 length 520: 4 00000020:01000000:3.0:1788541110.747446:0:13182:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d7bf695540 - data ffff98d7bf898438/ffff98d6812d0c00 00000020:01000000:3.0:1788541110.747882:0:13182:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d784dc81e0 - data ffff98d7bf842bd0/ffff98d782d69000 00100000:10000000:3.0:1788541110.762602:0:13182:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788541110.803120:0:13182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a87a 00000020:00000080:2.0:1788541110.803132:0:13182:0:(genops.c:885:class_export_put()) final put ffff98d7bf6da000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788541110.803185:0:13182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d7831d9800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788541110.803190:0:13182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7831d9800 2 00000020:01000004:2.0:1788541110.803193:0:13182:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d7831d9800 from lustre-OST0000 00000020:00000080:2.0:1788541110.803216:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541110.803226:0:13182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788541110.803242:0:13182:0:(genops.c:885:class_export_put()) final put ffff98d7bf6dd000/lustre-OST0000_UUID 00000020:00000080:2.0:1788541110.803245:0:13182:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf6dd000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788541110.803252:0:13182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788541110.803297:0:13182:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788541110.803301:0:13182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788541110.803306:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541110.803310:0:13182:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788541110.803317:0:13182:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff98d7901d3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541110.803323:0:13182:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff98d789948000) has exports, disconnecting them 00000020:00080000:2.0:1788541110.803329:0:13182:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff98d7901d3000), last request at 1788540890 00000020:00000080:2.0:1788541110.803334:0:13182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a8a4 00000020:00080000:2.0:1788541110.803343:0:13182:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d7901d3000): rc 0 00000020:00000080:2.0:1788541110.803348:0:13182:0:(genops.c:885:class_export_put()) final put ffff98d7901d3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788541110.803955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf6da000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788541110.805917:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7901d3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788541110.806466:0:13182:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788541110.806472:0:13182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541110.806478:0:13182:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541110.806485:0:13182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541110.806724:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541110.806733:0:13182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788541110.806741:0:13182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7831d9800 1 00000020:00000080:0.0:1788541110.806772:0:13182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a834 00000020:00000080:0.0:1788541110.806783:0:13182:0:(genops.c:885:class_export_put()) final put ffff98d7901d5800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788541110.806790:0:13182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788541110.806795:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541110.806800:0:13182:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541110.806804:0:13182:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff98d7ae254d40) has no exports 00000020:00000080:1.0:1788541110.807336:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7bf6d8800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788541110.807345:0:8:0:(genops.c:885:class_export_put()) final put ffff98d7bf6de000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788541110.807353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf6de000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788541110.807363:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788541110.807443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7901d5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788541110.835958:0:13182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541110.835977:0:13182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788541110.835984:0:13182:0:(genops.c:885:class_export_put()) final put ffff98d7831da000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788541110.835989:0:13182:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7831da000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788541110.836000:0:13182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788541110.836161:0:13182:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98d7831da800 00000020:02000400:1.0:1788541110.836221:0:13182:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788541110.888550:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541111.895606:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541112.919837:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788541113.822615:0:13337:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788541113.837708:0:13337:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788541113.837785:0:13337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541113.837796:0:13337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541113.837801:0:13337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541113.837805:0:13337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541113.837825:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788541113.837828:0:13337:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788541113.837849:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541113.837869:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d7adc2bb80 x1875420968473216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541114 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541113.837881:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d7bf4c4000 x1875420968473728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541120 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541113.837897:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d682925c00 x1875420968473856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541121 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541113.837905:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d682925180 x1875420968473984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541113.837910:0:13337:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541113.837915:0:13337:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788541113.837936:0:13337:0:(import.c:65:import_set_state_nolock()) ffff98d7bf70c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788541113.837959:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875420968474240:0@lo:39:umount.0 00000400:00000100:2.0:1788541113.838002:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420968474240 offset 0 length 224: 4 00000100:00100000:3.0:1788541113.838108:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968473728:0@lo:400:kworker.0 00000100:00100000:3.0:1788541113.838138:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968473984:0@lo:400:kworker.0 00000100:00100000:3.0:1788541113.838145:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968473856:0@lo:400:kworker.0 00000100:00100000:1.0:1788541113.838859:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968473216:0@lo:400:kworker.0 00010000:00010000:0.0:1788541113.839434:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541113.839442:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541113.839450:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678000 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541113.839453:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541113.839462:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541113.839467:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541113.839470:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541113.839472:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788541113.839474:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788541113.839487:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:0.0:1788541113.839489:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541113.839494:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d781678000/0xc9a6a13d3cd1aa4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aa56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541113.839515:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541113.839517:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541113.839519:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541113.945241:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541114.968947:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541115.864093:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788541115.864106:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788541115.992145:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541117.015625:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541118.040230:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541119.063563:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541120.089974:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541120.983711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541120.983721:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788541121.111675:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541122.136311:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541123.032002:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541113/real 1788541113] req@ffff98d682925f80 x1875420968474240/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541123.032038:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d682925f80 x1875420968474240/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788541123.032059:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7bf70c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788541123.032075:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875420968474240:0@lo:39:umount.0 00000100:00080000:2.0:1788541123.032382:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541123.032388:0:13337:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788541123.032393:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788541123.033437:0:13337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033454:0:13337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033461:0:13337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033499:0:13337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033529:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541123.033537:0:13337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033543:0:13337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033548:0:13337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033553:0:13337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.033575:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788541123.033581:0:13337:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788541123.033603:0:13337:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788541123.033607:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788541123.033622:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541123.033628:0:13337:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788541123.033639:0:13337:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98d789060000) has no exports 00000020:00080000:2.0:1788541123.033664:0:13337:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff98d789060000) has no exports 00010000:00010000:3.0:1788541123.034267:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541123.034275:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034282:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d781678200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541123.034286:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034293:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541123.034299:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541123.034305:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541123.034307:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788541123.034309:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788541123.034331:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:3.0:1788541123.034335:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034342:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d781678200/0xc9a6a13d3cd1aa5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aa64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034355:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541123.034359:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034364:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541123.034367:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034374:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541123.034380:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541123.034384:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788541123.034386:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788541123.034388:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788541123.034394:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:3.0:1788541123.034396:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034401:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7bf602800/0xc9a6a13d3cd1ac86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1ac8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.034461:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541123.034463:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541123.034465:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541123.036366:0:13031:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788541123.052847:0:13337:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d7bf695600 - data ffff98d79ef57d80/ffff98d6812d2400 00000020:01000000:2.0:1788541123.053082:0:13337:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff98d78637f960 - data ffff98d7bf8cc6c0/ffff98d681abcc00 00100000:10000000:0.0:1788541123.061585:0:13337:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788541123.088209:0:13337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a945 00000020:00000080:3.0:1788541123.088220:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7bf57c000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788541123.088245:0:13337:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d7bf6df000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788541123.088249:0:13337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7bf6df000 2 00000020:01000004:3.0:1788541123.088252:0:13337:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff98d7bf6df000 from lustre-OST0001 00000020:00000080:3.0:1788541123.088272:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541123.088283:0:13337:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788541123.088286:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7bf57e000/lustre-OST0001_UUID 00000020:00000080:3.0:1788541123.088289:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf57e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788541123.088295:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788541123.088452:0:13337:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6c6c881b-c5d1-4767-bf18-6c64f558276e->MGS 00010000:00010000:3.0:1788541123.088477:0:13337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541123.088490:0:13337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541123.088497:0:13337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788541123.088500:0:13337:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788541123.088503:0:13337:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788541123.088520:0:13337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:3.0:1788541123.088524:0:13337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7813fc200/0xc9a6a13d3cd1a857 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1a85e expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.088539:0:13337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541123.088560:0:13337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541123.088564:0:13337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541123.088567:0:13337:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788541123.088569:0:13337:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788541123.088578:0:13337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff98d7b2f5b800 00010000:00010000:3.0:1788541123.088581:0:13337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7999bd400/0xc9a6a13d3cd1aaa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc9a6a13d3cd1aaaa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788541123.088599:0:13337:0:(import.c:65:import_set_state_nolock()) ffff98d7b2f5b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788541123.088603:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788541123.088605:0:13337:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788541123.088606:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788541123.088611:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788541123.088623:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff98d7bf4c7b80 x1875420968474112/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788541125 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788541123.088646:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788541123.088650:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:2.0:1788541123.088993:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf57c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788541123.089132:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c6c881b-c5d1-4767-bf18-6c64f558276e:3313:1875420968474112:0@lo:250:kworker.0 10000000:01000000:3.0:1788541123.090207:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788541123.090219:0:13337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a738 00000020:00000080:3.0:1788541123.090227:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d786bf1800/6c6c881b-c5d1-4767-bf18-6c64f558276e 00000020:01000000:3.0:1788541123.090279:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.159@tcp (flags='') 00000020:00000080:3.0:1788541123.090286:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541123.090293:0:13337:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541123.090297:0:13337:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff98d7b2f70000) has no exports 00000020:00000080:2.0:1788541123.090628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d786bf1800/6c6c881b-c5d1-4767-bf18-6c64f558276e for MGC192.168.202.159@tcp 10000000:01000000:1.0:1788541123.091042:0:5848:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788541123.091135:0:13337:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.159@tcp: client import never connected 00000100:00080000:3.0:1788541123.091140:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788541123.091143:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788541123.091146:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788541123.091155:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788541123.091202:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541123.091209:0:13337:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.159@tcp (uuid 6c6c881b-c5d1-4767-bf18-6c64f558276e) 00000020:01000000:3.0:1788541123.091216:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788541123.091220:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541123.091224:0:13337:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788541123.091231:0:13337:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff98d7bf579800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788541123.091237:0:13337:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff98d7ae250000) has exports, disconnecting them 00000020:00080000:3.0:1788541123.091241:0:13337:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff98d7bf579800), last request at 1788540909 00000020:00000080:3.0:1788541123.091245:0:13337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a96f 00000020:00080000:3.0:1788541123.091258:0:13337:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff98d7bf579800): rc 0 00000020:00000080:3.0:1788541123.091261:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7bf579800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788541123.091818:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7b2f5b800 for MGC192.168.202.159@tcp 00000020:00000080:2.0:1788541123.091825:0:38:0:(genops.c:885:class_export_put()) final put ffff98d7b2f5c000/6c6c881b-c5d1-4767-bf18-6c64f558276e 00000020:00000080:2.0:1788541123.091828:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7b2f5c000/6c6c881b-c5d1-4767-bf18-6c64f558276e for MGC192.168.202.159@tcp 00000020:01000000:2.0:1788541123.091833:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.159@tcp (6c6c881b-c5d1-4767-bf18-6c64f558276e) 00000020:00000080:2.0:1788541123.092079:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf579800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788541123.093459:0:13337:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788541123.093474:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541123.093478:0:13337:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788541123.093485:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788541123.093603:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98d7bf70c000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788541123.098605:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788541123.098898:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788541123.099041:0:13031:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788541123.099176:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff98d782e3a800:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1788541123.099273:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff98d782e3b000:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1788541123.099369:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.099692:0:6720:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff98d7bf6ef800:6720] 3 exiting: rc = 0 00000100:00100000:1.0:1788541123.099767:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff98d782e14600:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1788541123.099816:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff98d790ca3a00:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1788541123.104878:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff98d782e15000:5837] 2 exiting: rc = 0 00000100:00100000:2.0:1788541123.105054:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105063:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105070:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105075:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105080:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105086:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105090:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105095:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105101:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105106:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105112:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105118:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105124:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105130:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105136:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105145:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105151:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105159:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105166:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105171:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105178:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105198:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105203:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105208:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105214:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105219:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105224:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105229:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105236:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105240:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105246:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105252:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105257:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105262:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105267:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105273:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105279:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105284:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105290:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105295:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105301:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105306:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105310:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105314:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105319:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105323:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105329:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105333:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105339:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105344:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105349:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105353:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105357:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105362:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105367:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105372:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105384:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105389:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105393:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105398:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105403:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105436:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105442:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.105448:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788541123.106199:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541123.106209:0:13337:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788541123.106215:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7bf4a6800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788541123.106220:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf4a6800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788541123.106225:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788541123.106273:0:13337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7bf6df000 1 00000020:00000080:2.0:1788541123.106278:0:13337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1a914 00000020:00000080:2.0:1788541123.106284:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7bf4a3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788541123.106302:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788541123.106307:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541123.106311:0:13337:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788541123.106315:0:13337:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff98d78994b380) has no exports 00000020:00000080:1.0:1788541123.107208:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7bf4a3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788541123.128204:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541123.128221:0:13337:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788541123.128228:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7901d7800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788541123.128232:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7901d7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788541123.128244:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788541123.130594:0:13337:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff98d7bfdb3800 00000020:01000000:1.0:1788541123.130623:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788541123.130630:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541123.130705:0:13337:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788541123.130709:0:13337:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff98d78994cd40) has no exports 00000020:00000080:1.0:1788541123.130807:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541123.130817:0:13337:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788541123.130823:0:13337:0:(genops.c:885:class_export_put()) final put ffff98d7901d4000/OSS_uuid 00000020:00000080:1.0:1788541123.130827:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff98d7901d4000/OSS_uuid for OSS 00000020:01000000:1.0:1788541123.130832:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788541123.130925:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff98d790c0f800:6704] 0 exiting: rc = 1 00000100:00100000:1.0:1788541123.131020:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff98d790c0fc00:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1788541123.131072:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff98d790c0e000:6706] 2 exiting: rc = 0 00000100:00100000:1.0:1788541123.131128:0:9248:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff98d7901dec00:9248] 3 exiting: rc = 0 00000100:00100000:1.0:1788541123.131194:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131202:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131208:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131215:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131220:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131238:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131244:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131249:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131254:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131258:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131263:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131268:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131275:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131280:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131285:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131291:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131296:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131301:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131307:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131313:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131318:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131324:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131329:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131333:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131339:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131344:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131349:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131354:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131360:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131365:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131370:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131376:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131382:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131386:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131391:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131396:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131401:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.131406:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1788541123.133828:0:5846:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788541123.134767:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134773:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134790:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134796:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134801:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134806:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134812:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134817:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134822:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134829:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134834:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134839:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134844:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134852:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134860:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134865:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134871:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134879:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134887:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134894:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134900:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134904:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134910:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134915:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134920:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.134925:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136168:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff98d790c0e400:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1788541123.136314:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff98d790c0ec00:6709] 1 exiting: rc = 0 00000100:00100000:2.0:1788541123.136593:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136601:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136606:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136612:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136617:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136622:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136627:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136700:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136708:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136714:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136719:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136725:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136802:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136807:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136813:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136818:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136823:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136828:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136833:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136838:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136843:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136848:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136852:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136857:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136861:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136866:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136870:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136875:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136879:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136884:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136889:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136894:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136899:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136903:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136908:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136912:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136917:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136923:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136927:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136932:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136937:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136941:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136945:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136950:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136954:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136960:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136964:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136974:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136979:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136984:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136989:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136994:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.136999:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137004:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137009:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137013:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137018:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137022:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137027:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137031:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137036:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137041:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137046:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.137056:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.142894:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff98d790c0fe00:6711] 1 exiting: rc = 0 00000100:00100000:1.0:1788541123.143112:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff98d78618e400:6712] 2 exiting: rc = 0 00000100:00100000:3.0:1788541123.144160:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff98d7ad6c2600:6710] 0 exiting: rc = 1 00000100:00100000:1.0:1788541123.144869:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144878:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144884:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144890:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144896:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144903:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144909:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144927:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144934:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144951:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144957:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144963:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144969:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144974:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144980:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144986:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144993:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.144999:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145005:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145011:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145017:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145023:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145030:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145037:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145043:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145049:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145055:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145062:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145069:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145075:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145082:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145104:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145112:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145118:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145125:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145131:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145138:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145145:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145152:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145158:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145166:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145173:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145179:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145184:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145197:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145202:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145208:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145214:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145220:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145226:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145231:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145237:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145241:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145257:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145263:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145269:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145275:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145281:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145288:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145293:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145299:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145306:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145311:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.145326:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.152399:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff98d7b4f9b600:6713] 0 exiting: rc = 1 00000100:00100000:1.0:1788541123.152553:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff98d7ad84ec00:6714] 1 exiting: rc = 0 00000100:00100000:1.0:1788541123.153108:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153117:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153141:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153148:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153153:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153159:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153164:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153168:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153173:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153177:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153182:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153187:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153191:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153196:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153214:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153218:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153223:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153228:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153233:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153237:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153242:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153248:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153253:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153258:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153263:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153268:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153272:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153277:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153283:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153288:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153295:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153300:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153304:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153309:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153315:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153320:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153325:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153330:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153335:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153339:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153343:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153348:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153354:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153359:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153365:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153369:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153374:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153379:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153384:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153398:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153836:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153847:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153855:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153860:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153866:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153871:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153877:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153882:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153887:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153892:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153896:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153901:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153906:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.153910:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541123.154813:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff98d7ad84e000:6715] 0 exiting: rc = 1 00000100:00100000:3.0:1788541123.154971:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff98d7b4f9b200:6716] 1 exiting: rc = 0 00000100:00100000:1.0:1788541123.155195:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155203:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155209:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155215:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155224:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155230:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155236:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155243:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155249:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155255:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155261:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155268:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155287:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155294:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155299:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155306:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155314:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155320:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155326:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155332:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155349:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155355:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155361:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155367:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155385:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155394:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155400:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155541:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155550:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155557:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155563:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155569:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155575:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155581:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155588:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155594:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155614:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155622:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155629:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155701:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155707:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155713:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155719:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155727:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155734:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155739:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155745:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155752:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155771:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155779:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155785:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155791:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155798:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155804:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155810:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155822:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155828:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155834:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155840:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155847:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155852:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155859:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155876:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541123.155882:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788541123.165185:0:13337:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788541139.340692:0:13952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788541147.419032:0:14413:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788541147.419037:0:14413:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788541147.419139:0:14413:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d682549800 00000020:01000004:1.0:1788541147.419153:0:14413:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788541147.419162:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788541147.419175:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff98d789063380) 00000020:00000080:1.0:1788541147.419186:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788541147.446338:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788541147.450075:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788541147.450762:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788541147.450910:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788541147.451099:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788541147.451167:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788541147.451321:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788541147.452049:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788541147.452160:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788541147.452523:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1788541147.454164:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 276: rc = 0 00100000:10000000:2.0:1788541147.454278:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 276: rc = 0 00100000:10000000:2.0:1788541147.455601:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 280: rc = 0 00100000:10000000:2.0:1788541147.456166:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 280: rc = 0 00100000:10000000:2.0:1788541147.456557:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 280: rc = 0 00100000:10000000:2.0:1788541147.456787:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 280: rc = 0 00100000:10000000:2.0:1788541147.457215:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 280: rc = 0 00100000:10000000:2.0:1788541147.457659:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 280: rc = 0 00100000:10000000:2.0:1788541147.458037:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 280: rc = 0 00100000:10000000:2.0:1788541147.458292:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 280: rc = 0 00100000:10000000:2.0:1788541147.458728:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 280: rc = 0 00100000:10000000:2.0:1788541147.459105:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 280: rc = 0 00100000:10000000:2.0:1788541147.459331:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 280: rc = 0 00100000:10000000:2.0:1788541147.459708:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 280: rc = 0 00100000:10000000:2.0:1788541147.460120:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 299: rc = 0 00100000:10000000:2.0:1788541147.460336:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 299: rc = 0 00100000:10000000:2.0:1788541147.460929:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 299: rc = 0 00100000:10000000:2.0:1788541147.461273:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 299: rc = 0 00100000:10000000:2.0:1788541147.461656:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 299: rc = 0 00100000:10000000:2.0:1788541147.461863:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 299: rc = 0 00100000:10000000:2.0:1788541147.462184:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 299: rc = 0 00100000:10000000:2.0:1788541147.462383:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 299: rc = 0 00100000:10000000:2.0:1788541147.462819:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 299: rc = 0 00100000:10000000:2.0:1788541147.463135:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 299: rc = 0 00100000:10000000:2.0:1788541147.463322:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 299: rc = 0 00100000:10000000:2.0:1788541147.463576:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 299: rc = 0 00100000:10000000:2.0:1788541147.463780:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 299: rc = 0 00100000:10000000:2.0:1788541147.464208:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 299: rc = 0 00100000:10000000:2.0:1788541147.465342:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 299: rc = 0 00100000:10000000:2.0:1788541147.466344:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 299: rc = 0 00100000:10000000:2.0:1788541147.466748:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 299: rc = 0 00100000:10000000:2.0:1788541147.466944:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 299: rc = 0 00100000:10000000:2.0:1788541147.467684:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 299: rc = 0 00100000:10000000:2.0:1788541147.467873:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 299: rc = 0 00100000:10000000:2.0:1788541147.468177:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 299: rc = 0 00100000:10000000:2.0:1788541147.469774:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 299: rc = 0 00100000:10000000:2.0:1788541147.470057:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 299: rc = 0 00100000:10000000:2.0:1788541147.470301:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 299: rc = 0 00100000:10000000:2.0:1788541147.470565:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 299: rc = 0 00100000:10000000:2.0:1788541147.470827:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 299: rc = 0 00100000:10000000:2.0:1788541147.471065:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 299: rc = 0 00100000:10000000:2.0:1788541147.471308:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 299: rc = 0 00100000:10000000:2.0:1788541147.471567:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 299: rc = 0 00100000:10000000:2.0:1788541147.471826:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 299: rc = 0 00100000:10000000:2.0:1788541147.472066:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 299: rc = 0 00100000:10000000:2.0:1788541147.474228:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 299: rc = 0 00100000:10000000:2.0:1788541147.475164:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 288: rc = 0 00100000:10000000:2.0:1788541147.476134:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788541147.476318:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 277: rc = 0 00100000:10000000:2.0:1788541147.476837:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788541147.477037:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 277: rc = 0 00100000:10000000:2.0:1788541147.477236:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788541147.477314:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 277: rc = 0 00100000:10000000:2.0:1788541147.478302:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788541147.478387:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1788541147.479045:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788541147.479124:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1788541147.479806:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788541147.479878:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00000020:00000080:2.0:1788541147.480208:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788541147.480215:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788541147.480225:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1ba39 00000020:01000004:2.0:1788541147.480233:0:14413:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788541147.480237:0:14413:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788541147.480242:0:14413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d682549800 from MGS 00000020:01000004:2.0:1788541147.480257:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788541147.480266:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff98d790103380) 00000020:00000080:2.0:1788541147.480280:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788541147.480400:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d682549800 from MGS, refs=2 00080000:01000000:2.0:1788541147.480715:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788541147.480723:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1ba47 00000100:00100000:2.0:1788541147.480816:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788541147.481060:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788541147.481066:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788541147.481827:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788541147.481834:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788541147.482886:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541147.483190:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788541147.483195:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788541147.484234:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788541147.484243:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788541147.484754:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788541147.484762:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788541147.486394:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541147.486399:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541147.486401:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541147.501157:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541147.501163:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541147.501166:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541147.502241:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788541147.503752:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788541147.544128:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788541147.544145:0:14413:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788541147.544147:0:14413:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788541147.553275:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788541147.555354:0:14413:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788541147.555710:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788541147.556357:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788541147.556916:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541147.557227:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788541147.557233:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788541147.558862:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788541147.558875:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788541147.560131:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788541147.560141:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788541147.561398:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788541147.561680:0:14413:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.159@tcp' 00000020:01000004:1.0:1788541147.561682:0:14413:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788541147.561710:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.159@tcp (typ=mgc) 00000020:00000080:1.0:1788541147.561731:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.159@tcp (ffff98d789060000) 00000020:00000080:1.0:1788541147.561747:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788541147.561821:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7ae227800@MGC192.168.202.159@tcp: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1788541147.562104:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.159@tcp-0 is initialized 00000040:01000000:1.0:1788541147.562110:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788541147.562724:0:14427:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788541147.562780:0:14428:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788541147.562847:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.159@tcp (uuid 2e59d638-365e-4b5a-a31c-1933ab9279a7) 00000020:00000080:0.0:1788541147.562864:0:14413:0:(genops.c:1385:class_connect()) connect: client 2e59d638-365e-4b5a-a31c-1933ab9279a7, cookie 0xc9a6a13d3cd1ba55 00000100:00080000:0.0:1788541147.562875:0:14413:0:(import.c:545:import_select_connection()) MGC192.168.202.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788541147.562881:0:14413:0:(import.c:665:import_select_connection()) MGC192.168.202.159@tcp: import ffff98d7ae227800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788541147.562923:0:14413:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bf4c4700 x1875420968474368/t0(0) o250->MGC192.168.202.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541147.562949:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2e59d638-365e-4b5a-a31c-1933ab9279a7->MGS 00000020:01000004:0.0:1788541147.562977:0:14413:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788541147.562986:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788541147.562996:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff98d7ada799c0) 00000020:00000080:0.0:1788541147.563005:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788541147.563267:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e59d638-365e-4b5a-a31c-1933ab9279a7:3313:1875420968474368:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788541147.563333:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.563456:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968474368 00000100:00100000:3.0:1788541147.563464:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968474368 00000100:00100000:3.0:1788541147.563494:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541147.563501:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1875420968474368:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788541147.563523:0:14424:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2e59d638-365e-4b5a-a31c-1933ab9279a7@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:3.0:1788541147.563552:0:14424:0:(genops.c:1385:class_connect()) connect: client 2e59d638-365e-4b5a-a31c-1933ab9279a7, cookie 0xc9a6a13d3cd1ba63 00000100:00080000:3.0:1788541147.563667:0:14424:0:(import.c:65:import_set_state_nolock()) ffff98d78999f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541147.563719:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+5:3313:x1875420968474368:12345-0@lo:250:mount.lustre.0 Request processed in 217us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.563727:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541147.563863:0:3313:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788541147.563871:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.159@tcp: connect to target with instance 0 00000100:00080000:1.0:1788541147.563878:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788541147.563881:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788541147.563883:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7ae227800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788541147.563886:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788541147.563898:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788541147.563911:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e59d638-365e-4b5a-a31c-1933ab9279a7:3313:1875420968474368:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788541147.581236:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788541147.582670:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788541147.582681:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788541147.588154:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788541147.588168:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788541147.588793:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788541147.588802:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788541147.589690:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788541147.589855:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788541147.589861:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788541147.591182:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788541147.591191:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788541147.648878:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541147.649125:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788541147.649132:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788541147.654787:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788541147.654868:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788541147.664781:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541147.665050:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788541147.665064:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788541147.666024:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788541147.666033:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788541147.670026:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541147.670212:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788541147.670218:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788541147.675325:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788541147.675346:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788541147.680129:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541147.680310:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541147.680316:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788541147.681084:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788541147.681092:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788541147.707967:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541147.708211:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788541147.708217:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788541147.709279:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788541147.709289:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788541147.710141:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788541147.710151:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788541147.711559:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788541147.711582:0:14413:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788541147.711588:0:14413:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788541147.711703:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788541147.711734:0:14413:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788541147.711739:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788541147.711741:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541147.711742:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541147.711743:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541147.711744:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541147.711746:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541147.711747:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541147.711748:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541147.711750:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541147.711751:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541147.711753:0:14413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788541147.711755:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541147.711756:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541147.711757:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541147.711758:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541147.711759:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541147.711763:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541147.711764:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541147.711765:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541147.711766:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541147.711767:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541147.711798:0:14413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788541147.711816:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541147.711876:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.712081:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782bde480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.722552:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968474496 00000100:00100000:3.0:1788541147.722566:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968474496 00000100:00100000:3.0:1788541147.722657:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541147.722669:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+5:14413:x1875420968474496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788541147.722713:0:14426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788541147.722716:0:14426:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788541147.722719:0:14426:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788541147.727369:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788541147.727819:0:14426:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788541147.728763:0:14447:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788541147.728769:0:14447:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788541147.728773:0:14447:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788541147.728806:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788541147.729052:0:14426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788541147.729063:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788541147.742052:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+5:14413:x1875420968474496:12345-0@lo:253:mount.lustre.0 Request processed in 19374us (30164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541147.742072:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541147.742170:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788541147.742187:0:14413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788541147.742190:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788541147.742192:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788541147.742193:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541147.742195:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541147.742196:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541147.742198:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541147.742199:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788541147.742201:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788541147.742203:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541147.742204:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788541147.742240:0:14413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d682549800 from lustre-MDT0000 10000000:01000000:3.0:1788541147.742275:0:14413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788541147.742279:0:14413:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788541147.742283:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98d789060000 10000000:01000000:3.0:1788541147.742287:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541147.742295:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98d789060000 from 1 10000000:01000000:3.0:1788541147.742298:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788541147.742336:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.742348:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.742357:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541147.742377:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541147.742457:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.742494:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.742656:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968474624 00000100:00100000:1.0:1788541147.742663:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968474624 00000100:00100000:1.0:1788541147.742705:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541147.742715:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+5:14413:x1875420968474624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541147.742728:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541147.742742:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031800/0xc9a6a13d3cd1ba71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ba6a expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.742778:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031800/0xc9a6a13d3cd1ba71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ba6a expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.742789:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031800/0xc9a6a13d3cd1ba71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ba6a expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.742799:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031800, rc 0) 00000100:00100000:1.0:1788541147.742839:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+6:14413:x1875420968474624:12345-0@lo:101:mount.lustre.0 Request processed in 125us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.742846:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541147.742947:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541147.742962:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.742973:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541147.743016:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541147.743040:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.743062:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541147.743109:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968474752 00000100:00100000:2.0:1788541147.743114:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968474752 00000100:00100000:2.0:1788541147.743143:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788541147.743150:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+6:14413:x1875420968474752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541147.743377:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+6:14413:x1875420968474752:12345-0@lo:501:mount.lustre.0 Request processed in 227us (335us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788541147.743385:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541147.743576:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474752:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788541147.743599:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788541147.743613:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743623:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541147.743631:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d682549800 10000000:01000000:3.0:1788541147.743636:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788541147.743641:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98d682549800 10000000:01000000:3.0:1788541147.743644:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788541147.743647:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98d682549800 from 1 10000000:01000000:3.0:1788541147.743649:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788541147.743668:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743676:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743685:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541147.743698:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474880:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541147.743723:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.743749:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968474880 00000100:00100000:3.0:1788541147.743753:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968474880 00000100:00100000:3.0:1788541147.743783:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541147.743790:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+6:14413:x1875420968474880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541147.743805:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541147.743816:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ba7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ba78 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743834:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ba7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ba78 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743843:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cd600/0xc9a6a13d3cd1ba7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ba78 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743852:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd600, rc 0) 00000100:00100000:3.0:1788541147.743875:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+7:14413:x1875420968474880:12345-0@lo:101:mount.lustre.0 Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.743881:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541147.743911:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.743922:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968474880:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541147.743932:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba7f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743940:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ba7f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541147.743950:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788541147.743955:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba7f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.743962:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cc200/0xc9a6a13d3cd1ba78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba7f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541147.743978:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788541147.743981:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541147.743985:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98d682549800 10000000:01000000:3.0:1788541147.743988:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788541147.743991:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788541147.743993:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788541147.744006:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.744013:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.744021:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541147.744032:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541147.744054:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.744073:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968475008 00000100:00100000:3.0:1788541147.744077:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968475008 00000100:00100000:3.0:1788541147.744092:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541147.744098:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+7:14413:x1875420968475008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541147.744105:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541147.744112:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cd400/0xc9a6a13d3cd1ba8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1ba86 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.744126:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cd400/0xc9a6a13d3cd1ba8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ba86 expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.744145:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cd400/0xc9a6a13d3cd1ba8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1ba86 expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.744153:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd400, rc 0) 00000100:00100000:3.0:1788541147.744175:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+8:14413:x1875420968475008:12345-0@lo:101:mount.lustre.0 Request processed in 77us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.744181:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541147.744200:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.744210:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541147.744220:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba8d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.744228:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1ba8d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541147.744279:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541147.744302:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.744319:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968475136 00000100:00100000:3.0:1788541147.744323:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968475136 00000100:00100000:3.0:1788541147.744337:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541147.744343:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+8:14413:x1875420968475136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541147.744773:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.745110:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14413:x1875420968475136:12345-0@lo:501:mount.lustre.0 Request processed in 765us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.745118:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788541147.745311:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541147.745349:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541147.745391:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.745446:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782bdee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.745604:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968475264 00000100:00100000:1.0:1788541147.745609:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968475264 00000100:00100000:1.0:1788541147.745647:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541147.745655:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14413:x1875420968475264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541147.745959:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14413:x1875420968475264:12345-0@lo:503:mount.lustre.0 Request processed in 304us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.745967:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788541147.746079:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541147.747861:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14448:1875420968475392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541147.747937:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541147.747978:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.748036:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968475392 00000100:00100000:3.0:1788541147.748042:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968475392 00000100:00100000:3.0:1788541147.748090:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541147.748100:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14448:x1875420968475392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541147.748850:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14448:x1875420968475392:12345-0@lo:502:llog_process_th.0 Request processed in 748us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.748860:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541147.748978:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14448:1875420968475392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541147.749017:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541147.749028:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.749030:0:14448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788541147.749036:0:14448:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788541147.749039:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788541147.749053:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff98d7901019c0) 00000020:00000080:2.0:1788541147.749073:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788541147.749079:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788541147.749149:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788541147.749156:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1ba9b 00000020:00000080:2.0:1788541147.749385:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788541147.749390:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541147.749394:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.749396:0:14448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788541147.749398:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541147.749402:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.749403:0:14448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788541147.749709:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788541147.749721:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff98d790100000) 00000020:00000080:2.0:1788541147.749732:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788541147.749738:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788541147.749740:0:14448:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788541147.749743:0:14448:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788541147.749749:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788541147.749805:0:14448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d682549800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788541147.749817:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff98d790104d40) 00000020:00000080:2.0:1788541147.749825:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788541147.749877:0:14448:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788541147.749882:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1bab0 00000020:00000080:2.0:1788541147.749997:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788541147.750003:0:14448:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788541147.750009:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc9a6a13d3cd1bab7 00080000:01000000:2.0:1788541147.750019:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788541147.750023:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1babe 00010000:00010000:3.0:1788541147.832297:0:14448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788541147.832740:0:14448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788541147.832919:0:14448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788541147.833473:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff98d7ae2519c0) 00000020:00000080:3.0:1788541147.833493:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788541147.833556:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788541147.833563:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1bacc 00000020:00000080:3.0:1788541147.839527:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788541147.851745:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc9a6a13d3cd1bad3 00000020:00000080:1.0:1788541147.854636:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788541147.854651:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541147.854659:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541147.854662:0:14448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788541147.854664:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541147.854667:0:14448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788541147.854669:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541147.854683:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541147.854684:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541147.854687:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541147.854688:0:14448:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541147.854691:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541147.854696:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541147.854697:0:14448:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788541147.854702:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788541147.854748:0:14448:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788541147.854765:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541147.854768:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541147.854769:0:14448:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788541147.854772:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541147.854775:0:14448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788541147.854778:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541147.854780:0:14448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788541147.854783:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541147.854787:0:14448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:1.0:1788541147.854812:0:14448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788541147.854814:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541147.854829:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98d789064d40) 00000020:00000080:1.0:1788541147.854845:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788541147.854850:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541147.854902:0:14448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788541147.854908:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788541147.854914:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1bae1 00010000:00080000:1.0:1788541147.854958:0:14448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7b4007800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:1.0:1788541147.855179:0:14448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788541147.855608:0:14448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541147.855651:0:14448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788541147.856560:0:14448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541147.856613:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788541147.856700:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788541147.859709:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788541147.859717:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788541147.866704:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788541147.866719:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788541147.866758:0:14448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788541147.866779:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1bae8 00000100:00080000:3.0:1788541147.866790:0:14448:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541147.866797:0:14448:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d7b4007800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1788541147.866836:0:14448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7b2f31f80 x1875420968475520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541147.866867:0:14448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788541147.866937:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541147.866941:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541147.866943:0:14448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788541147.866946:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788541147.866948:0:14448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788541147.866956:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541147.866958:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541147.866960:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788541147.866962:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541147.866964:0:14448:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788541147.866967:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788541147.866971:0:14448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788541147.866974:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541147.866975:0:14448:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788541147.866978:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788541147.866983:0:14448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.159@tcp to nid 0x20000c0a8ca9f (192.168.202.159@tcp) 00000020:01000000:3.0:1788541147.867007:0:14448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788541147.867010:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541147.867022:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98d7ae250000) 00000020:00000080:3.0:1788541147.867033:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788541147.867038:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788541147.867092:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968475520:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1788541147.867102:0:14448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788541147.867107:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788541147.867112:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc9a6a13d3cd1baf6 00010000:00080000:3.0:1788541147.867144:0:14448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7b4003800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.159@tcp at head 00000400:00000100:1.0:1788541147.867149:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420968475520 offset 0 length 520: 4 00010000:00010000:3.0:1788541147.867346:0:14448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788541147.867650:0:14448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788541147.867671:0:14448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788541147.868214:0:14448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541147.868304:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788541147.868389:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788541147.872018:0:14454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788541147.872025:0:14454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788541147.872786:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788541147.872800:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788541147.872831:0:14448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788541147.872849:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1bafd 00000100:00080000:2.0:1788541147.872859:0:14448:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541147.872865:0:14448:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d7b4003800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1788541147.872900:0:14448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d682924000 x1875420968475648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541147.872932:0:14448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788541147.872988:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541147.872992:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.872994:0:14448:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788541147.872997:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541147.873001:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.873003:0:14448:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788541147.873006:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788541147.873008:0:14448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788541147.873010:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541147.873013:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.873014:0:14448:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788541147.873017:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541147.873019:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.873021:0:14448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788541147.873024:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788541147.873053:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14448:1875420968475776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541147.873139:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.873185:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788541147.873189:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968475776 00000100:00100000:0.0:1788541147.873195:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968475776 00000100:00100000:0.0:1788541147.873237:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541147.873238:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968475648:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788541147.873257:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14448:x1875420968475776:12345-0@lo:502:llog_process_th.0 00000400:00000100:1.0:1788541147.873275:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420968475648 offset 0 length 520: 4 00000100:00100000:0.0:1788541147.873510:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14448:x1875420968475776:12345-0@lo:502:llog_process_th.0 Request processed in 254us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541147.873517:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541147.875583:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14448:1875420968475776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541147.875629:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541147.875639:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541147.875642:0:14448:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788541147.875649:0:14448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788541147.876096:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788541147.876118:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788541147.876139:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba8d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.876151:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cdc00/0xc9a6a13d3cd1ba86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba8d expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541147.876160:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d682549800 from 1 10000000:01000000:0.0:1788541147.876163:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541147.876212:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.876220:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.876230:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541147.876263:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541147.876317:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541147.876360:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7909290c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.876547:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968475904 00000100:00100000:1.0:1788541147.876554:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968475904 00000100:00100000:1.0:1788541147.876587:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541147.876595:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+9:14413:x1875420968475904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541147.876607:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541147.876619:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb04 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.876641:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.876650:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.876659:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031600, rc 0) 00000100:00100000:1.0:1788541147.876698:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+10:14413:x1875420968475904:12345-0@lo:101:mount.lustre.0 Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.876704:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541147.876810:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968475904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541147.876828:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541147.876838:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541147.877341:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476032:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788541147.877378:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.877594:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.878267:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476032 00000100:00100000:3.0:1788541147.878274:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476032 00000100:00100000:3.0:1788541147.878315:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541147.878323:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+10:14413:x1875420968476032:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788541147.878340:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788541147.878345:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788541147.878445:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+10:14413:x1875420968476032:12345-0@lo:256:mount.lustre.0 Request processed in 123us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.878453:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541147.878757:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476032:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788541147.879283:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788541147.879305:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541147.879316:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541147.879325:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d682549800 from 1 10000000:01000000:2.0:1788541147.879327:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541147.879404:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541147.880540:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541147.880553:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541147.880580:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541147.880646:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.880678:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788541147.881162:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476160 00000100:00100000:0.0:1788541147.881171:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476160 00000100:00100000:0.0:1788541147.881230:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541147.881252:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+10:14413:x1875420968476160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541147.881268:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541147.881290:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb12 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.881318:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.881329:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.881339:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6000, rc 0) 00000100:00100000:0.0:1788541147.881392:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968476160:12345-0@lo:101:mount.lustre.0 Request processed in 153us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541147.881398:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541147.881761:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541147.881778:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541147.881788:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541147.881848:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541147.881876:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.881907:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.881991:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476288 00000100:00100000:1.0:1788541147.881997:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476288 00000100:00100000:1.0:1788541147.882029:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788541147.882044:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968476288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541147.882455:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968476288:12345-0@lo:501:mount.lustre.0 Request processed in 411us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.882463:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541147.883031:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541147.883074:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541147.883116:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.883151:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.884157:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476416 00000100:00100000:3.0:1788541147.884183:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476416 00000100:00100000:3.0:1788541147.884229:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541147.884237:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968476416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541147.884501:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968476416:12345-0@lo:503:mount.lustre.0 Request processed in 264us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.884509:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541147.884561:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541147.892639:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14456:1875420968476544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541147.892731:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.892856:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.893029:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476544 00000100:00100000:1.0:1788541147.893038:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476544 00000100:00100000:1.0:1788541147.893124:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788541147.893136:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14456:x1875420968476544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541147.893452:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14456:x1875420968476544:12345-0@lo:502:llog_process_th.0 Request processed in 316us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.893470:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541147.893567:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14456:1875420968476544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541147.893599:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541147.893611:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541147.893614:0:14456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788541147.893621:0:14456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d682549800 00000020:00000080:0.0:1788541147.893625:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541147.893632:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541147.893634:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541147.893636:0:14456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788541147.893638:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541147.893640:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541147.893642:0:14456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788541147.893645:0:14456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d682549800 00000020:00000080:0.0:1788541147.893648:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788541147.893704:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541147.893707:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541147.893709:0:14456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788541147.893712:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541147.893714:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541147.893715:0:14456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788541147.893719:0:14456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d682549800 00000020:00000080:0.0:1788541147.893721:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788541147.893759:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14456:1875420968476672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541147.893798:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.898294:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476672 00000100:00100000:3.0:1788541147.898309:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476672 00000100:00100000:3.0:1788541147.898356:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788541147.898366:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14456:x1875420968476672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541147.898672:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14456:x1875420968476672:12345-0@lo:502:llog_process_th.0 Request processed in 307us (4874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.898680:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788541147.899234:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7909290c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541147.899278:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14456:1875420968476672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788541147.899311:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541147.899321:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541147.899323:0:14456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788541147.899327:0:14456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788541147.899579:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788541147.899598:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788541147.899617:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.899629:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541147.899676:0:14413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788541147.899679:0:14413:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d682549800 10000000:01000000:1.0:1788541147.899682:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d682549800 10000000:01000000:1.0:1788541147.899686:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788541147.899692:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d682549800 from 1 10000000:01000000:1.0:1788541147.899695:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788541147.899729:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.899737:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.899755:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541147.899776:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541147.899828:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541147.900035:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541147.900273:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476800 00000100:00100000:3.0:1788541147.900281:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476800 00000100:00100000:3.0:1788541147.900329:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788541147.900340:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968476800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541147.900352:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541147.900365:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1bb27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb20 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.900389:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1bb27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb20 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.900425:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4ccc00/0xc9a6a13d3cd1bb27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb20 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541147.900434:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4ccc00, rc 0) 00000100:00100000:3.0:1788541147.900487:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14413:x1875420968476800:12345-0@lo:101:mount.lustre.0 Request processed in 149us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.900494:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541147.903187:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541147.903218:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb27 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.903229:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb27 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541147.903319:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541147.903379:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541147.903448:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.903480:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968476928 00000100:00100000:1.0:1788541147.903488:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968476928 00000100:00100000:1.0:1788541147.903527:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541147.903536:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14413:x1875420968476928:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541147.903776:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14413:x1875420968476928:12345-0@lo:501:mount.lustre.0 Request processed in 240us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.903785:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541147.903822:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968476928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541147.903849:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968477056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541147.903889:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541147.903906:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bc7f2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541147.903920:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477056 00000100:00100000:1.0:1788541147.903924:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477056 00000100:00100000:1.0:1788541147.903943:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788541147.903948:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14413:x1875420968477056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541147.904275:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14413:x1875420968477056:12345-0@lo:503:mount.lustre.0 Request processed in 325us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541147.904282:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788541147.904318:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968477056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541147.913600:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14461:1875420968477184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541147.913688:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541147.913736:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831ca840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541147.913921:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477184 00000100:00100000:2.0:1788541147.913929:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477184 00000100:00100000:2.0:1788541147.913979:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541147.913988:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14461:x1875420968477184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541147.914230:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14461:x1875420968477184:12345-0@lo:502:llog_process_th.0 Request processed in 243us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541147.914238:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788541147.914499:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14461:1875420968477184:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788541147.914565:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788541147.914580:0:14461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff98d7ada78000) 00000020:00000080:0.0:1788541147.914597:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788541147.914662:0:14461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d682549800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788541147.914666:0:14461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d682549800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788541147.914669:0:14461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d682549800 4 00010000:00080000:0.0:1788541147.914694:0:14461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7915b4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.159@tcp at head 00010000:00010000:0.0:1788541147.917931:0:14461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788541147.918125:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788541147.918156:0:14461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788541147.918167:0:14461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc9a6a13d3cd1bb35 00000100:00080000:0.0:1788541147.918176:0:14461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788541147.918182:0:14461:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98d7915b4800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788541147.918212:0:14461:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bf4c6300 x1875420968477312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541147.918239:0:14461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788541147.918432:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968477312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541147.918501:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541147.918566:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477312 00000100:00100000:1.0:1788541147.918573:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477312 00000100:00100000:1.0:1788541147.918602:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541147.918608:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875420968477312:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541147.918654:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875420968477312:12345-0@lo:38:llog_process_th.0 Request processed in 45us (152us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788541147.918661:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541147.918687:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788541147.918694:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7915b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541147.918698:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788541147.918701:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968477312:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541147.922263:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14461:1875420968477440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541147.922340:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541147.922372:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477440 00000100:00100000:0.0:1788541147.922378:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477440 00000100:00100000:0.0:1788541147.922459:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788541147.922468:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14461:x1875420968477440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541147.922679:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14461:x1875420968477440:12345-0@lo:502:llog_process_th.0 Request processed in 212us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541147.922690:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788541147.922724:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7831cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541147.922741:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e59d638-365e-4b5a-a31c-1933ab9279a7:14461:1875420968477440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788541147.922762:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788541147.923185:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788541147.923205:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788541147.923445:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb27 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541147.923457:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031000/0xc9a6a13d3cd1bb20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb27 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788541147.923500:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788541147.923502:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541147.923503:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541147.923504:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541147.923506:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541147.923507:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541147.923508:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541147.923509:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541147.923511:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541147.923512:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788541147.923516:0:14413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788541147.923518:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541147.923520:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541147.923521:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541147.923522:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541147.923523:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541147.923524:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541147.923525:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541147.923529:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541147.923530:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541147.923531:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788541147.923546:0:14413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788541147.923558:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968477568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541147.923592:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541147.923617:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541147.931718:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477568 00000100:00100000:0.0:1788541147.931734:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477568 00000100:00100000:0.0:1788541147.931796:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788541147.931807:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14413:x1875420968477568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788541147.931840:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788541147.931853:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788541148.017492:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788541148.017506:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788541148.017847:0:14446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788541148.017853:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788541148.017875:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.017895:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.017903:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.017942:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.017957:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 12 pid: 14426 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541148.017971:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1875420968477696:0@lo:104: 00000100:00100000:3.0:1788541148.018033:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.018086:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78b378f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541148.018167:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477696 00000100:00100000:0.0:1788541148.018176:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477696 00000100:00100000:0.0:1788541148.018228:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541148.018239:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14446:x1875420968477696:12345-0@lo:104: 00010000:00010000:0.0:1788541148.018262:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018319:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788541148.018326:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14446:x1875420968477696:12345-0@lo:104: Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541148.018332:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788541148.018352:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541148.018358:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018365:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6400 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541148.018381:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018390:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541148.018397:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541148.018403:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541148.018456:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018464:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541148.018482:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018490:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7912f6400/0xc9a6a13d3cd1bb04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb0b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018504:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541148.018506:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541148.018508:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541148.018535:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968477824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541148.018562:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541148.018614:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477824 00000100:00100000:0.0:1788541148.018618:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477824 00010000:00010000:0.0:1788541148.018634:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 13 pid: 14426 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541148.018656:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541148.018668:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+13:3316:x1875420968477824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541148.018678:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541148.018683:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 13 pid: 14426 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018693:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 13 pid: 14426 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018709:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018717:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788541148.018729:0:14416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000877599s 00010000:00010000:0.0:1788541148.018733:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018739:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018745:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018751:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018756:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541148.018761:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018777:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018785:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.018794:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541148.018822:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+13:3316:x1875420968477824:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541148.018829:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541148.018862:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968477824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541148.019009:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031600/0xc9a6a13d3cd1bb0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb04 expref: 12 pid: 14426 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541148.019031:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1875420968477696:0@lo:104: 00010000:00010000:3.0:1788541148.019044:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.019054:0:14446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.019060:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541148.019066:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541148.040064:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14413:x1875420968477568:12345-0@lo:253:mount.lustre.0 Request processed in 108250us (116461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541148.040080:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788541148.040233:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:14413:1875420968477568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541148.040264:0:14413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788541148.040268:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541148.040270:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541148.040271:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541148.040272:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541148.040273:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541148.040275:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541148.040276:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541148.040278:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541148.040279:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541148.040281:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788541148.040295:0:14413:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788541148.045278:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788541148.045567:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788541148.045856:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788541148.046003:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788541148.046382:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788541148.046637:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788541148.047620:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788541148.047748:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788541148.047962:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788541148.048270:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788541148.048586:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788541148.048709:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788541148.095642:0:14413:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788541148.096051:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788541148.096378:0:14469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788541148.096475:0:14469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541148.103505:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788541148.103579:0:14469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788541148.103584:0:14469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788541148.104466:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788541148.104584:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788541148.105019:0:14413:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788541148.105025:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788541148.105129:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541148.106114:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1788541148.108353:0:14468:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788541148.108361:0:14468:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788541148.109995:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788541148.110070:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788541148.111729:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788541148.123841:0:14413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788541148.149251:0:14413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788541148.149292:0:14413:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb64401cd3988 00100000:10000000:3.0:1788541148.149300:0:14413:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788541148.150952:0:14413:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788541148.150968:0:14413:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788541148.150986:0:14413:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788541148.151009:0:14413:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788541148.567624:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788541148.635164:0:14428:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788541148.635172:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d682549800 from 6 10000000:01000000:1.0:1788541148.635187:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788541148.635232:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541148.635256:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541148.635268:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541148.635294:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968477952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541148.635361:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.635437:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d790c62b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541148.635503:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968477952 00000100:00100000:0.0:1788541148.635511:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968477952 00000100:00100000:0.0:1788541148.635571:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788541148.635581:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14428:x1875420968477952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541148.635603:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541148.635618:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb43 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.635982:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.635993:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541148.636002:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7e00, rc 0) 00000100:00100000:0.0:1788541148.636053:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968477952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 473us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541148.636061:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788541148.636148:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968477952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541148.636164:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541148.636173:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541148.636220:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968478080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788541148.636263:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.636323:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d790c62b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541148.636357:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968478080 00000100:00100000:0.0:1788541148.636361:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968478080 00000100:00100000:0.0:1788541148.644068:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788541148.644093:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968478080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788541148.644124:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788541148.644148:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788541148.644152:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788541148.644298:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968478080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 217us (8034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541148.644305:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788541148.648012:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968478080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788541148.648082:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541148.648093:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541148.648117:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541148.952025:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541149.592531:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541149.982724:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541150.615615:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541151.641847:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541152.664535:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541153.058003:0:14712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788541153.239612:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541153.239619:0:13994:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541153.239622:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541153.239626:0:13994:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541153.239628:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788541153.239631:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788541153.239635:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7915b4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541153.239654:0:13994:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff98d7915b4800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1788541153.239675:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d682925880 x1875420968478336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541153.239705:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541153.239722:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.239794:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541153.239864:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968478336:0@lo:38:kworker.0 00000100:00100000:2.0:1788541153.239896:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541153.239930:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968478208 00000100:00100000:2.0:1788541153.239937:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968478208 00000100:00100000:2.0:1788541153.239980:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788541153.239988:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:3316:x1875420968478208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.240034:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:3316:x1875420968478208:12345-0@lo:400:kworker.0 Request processed in 47us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541153.240054:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788541153.240099:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968478208:0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.240494:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968478336 00000100:00100000:2.0:1788541153.240499:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968478336 00000100:00100000:2.0:1788541153.241742:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541153.241751:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875420968478336:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788541153.241778:0:14432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1788541153.241817:0:14432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc9a6a13d3cd1bb51 00000004:00100000:2.0:1788541153.241833:0:14432:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788541153.241967:0:14432:0:(import.c:65:import_set_state_nolock()) ffff98d7adc63000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541153.242042:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875420968478336:12345-0@lo:38:kworker.0 Request processed in 289us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541153.242048:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788541153.242758:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d682925880 x1875420968478336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541153.242776:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788541153.242784:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788541153.242789:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788541153.242792:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7915b4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788541153.242798:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875420968478336:0@lo:38:kworker.0 00010000:00010000:0.0:1788541153.689673:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541154.712586:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541155.739303:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788541156.007780:0:14863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeef2706e0 20000000:00000080:2.0:1788541156.007796:0:14863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d7bd208800 uarg=0000000000000000 20000000:01000000:2.0:1788541156.008068:0:14863:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788541156.008077:0:14863:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788541156.008082:0:14863:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788541156.011162:0:14864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788541156.013192:0:14863:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788541156.024613:0:14863:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788541156.024756:0:14863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541156.024776:0:14863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541156.024785:0:14863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541156.024858:0:14863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541156.024877:0:14863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 11 pid: 14425 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541156.024892:0:14863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14863:1875420968478464:0@lo:104: 00000100:00100000:2.0:1788541156.024957:0:14863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541156.025019:0:14863:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7861273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541156.025166:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968478464 00000100:00100000:1.0:1788541156.025185:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968478464 00000100:00100000:1.0:1788541156.025237:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541156.025247:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14863:x1875420968478464:12345-0@lo:104: 00010000:00010000:1.0:1788541156.025260:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541156.025322:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541156.025329:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14863:x1875420968478464:12345-0@lo:104: Request processed in 83us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541156.025336:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541156.029467:0:14863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14863:1875420968478464:0@lo:104: 00010000:00010000:3.0:1788541156.029497:0:14863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032319:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541156.032335:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032371:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541156.032387:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032401:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541156.032422:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541156.032429:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541156.032481:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032486:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541156.032511:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032518:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7bf603800/0xc9a6a13d3cd1bb12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb19 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032537:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541156.032539:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541156.032541:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541156.032580:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968478592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541156.032642:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541156.032694:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968478592 00000100:00100000:0.0:1788541156.032700:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968478592 00010000:00010000:0.0:1788541156.032726:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 12 pid: 14425 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541156.032760:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541156.032767:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:3314:x1875420968478592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541156.032780:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541156.032784:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 12 pid: 14425 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032795:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 12 pid: 14425 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032809:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7912f6000/0xc9a6a13d3cd1bb19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb12 expref: 12 pid: 14425 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032821:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032829:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032842:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032850:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032856:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032862:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032878:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541156.032883:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032890:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032902:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541156.032910:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541156.032941:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:3314:x1875420968478592:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541156.032948:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541156.032986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968478592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541156.033449:0:14863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541156.033458:0:14863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541156.033465:0:14863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7bf602800/0xc9a6a13d3cd1bb58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541156.760742:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541157.338523:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541147/real 1788541147] req@ffff98d682924000 x1875420968475648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541157.338558:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d682924000 x1875420968475648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541157.338569:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541147/real 1788541147] req@ffff98d7b2f31f80 x1875420968475520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541157.338580:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d7b2f31f80 x1875420968475520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541157.338598:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541157.338645:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541157.338648:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968475648:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788541157.338654:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4007800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541157.345626:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541157.345636:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788541157.345640:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7b4007800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541157.345650:0:13994:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:0.0:1788541157.345658:0:13994:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541157.345666:0:13994:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d7b4007800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788541157.345692:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bf4c4e00 x1875420968478848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541157.345705:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541157.345708:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788541157.345725:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541157.345729:0:13994:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:0.0:1788541157.345732:0:13994:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541157.345737:0:13994:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d7b4003800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788541157.345750:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bf4c7480 x1875420968478976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541157.345805:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541157.345821:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968479104:0@lo:400:kworker.0 00000100:00100000:0.0:1788541157.345906:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541157.345999:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479104 00000100:00100000:0.0:1788541157.346008:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479104 00000100:00100000:0.0:1788541157.346062:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541157.346073:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968479104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541157.346246:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e59d638-365e-4b5a-a31c-1933ab9279a7:3315:1875420968478720:0@lo:400:kworker.0 00000100:00100000:1.0:1788541157.346291:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541157.346584:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968478720 00000100:00100000:1.0:1788541157.346590:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968478720 00000100:00100000:1.0:1788541157.346622:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541157.346628:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:3315:x1875420968478720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541157.346664:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:3315:x1875420968478720:12345-0@lo:400:kworker.0 Request processed in 36us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541157.346684:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541157.346740:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e59d638-365e-4b5a-a31c-1933ab9279a7:3315:1875420968478720:0@lo:400:kworker.0 00000100:00100000:0.0:1788541157.346866:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968479104:12345-0@lo:400:kworker.0 Request processed in 794us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541157.346874:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788541157.348366:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541157.348377:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968475520:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788541157.348588:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968478848:0@lo:8:kworker.0 00000400:00000100:3.0:1788541157.348645:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420968478848 offset 0 length 520: 4 00000100:00100000:3.0:1788541157.348681:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968478976:0@lo:8:kworker.0 00000400:00000100:3.0:1788541157.348719:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420968478976 offset 0 length 520: 4 00010000:00080000:1.0:1788541157.349257:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d7bf4c5c00 x1875420968479104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541157.349273:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968479104:0@lo:400:kworker.0 10000000:01000000:3.0:1788541157.399596:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541157.399605:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d682549800 from 10 10000000:01000000:3.0:1788541157.399610:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541157.399659:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541157.399671:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541157.399683:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541157.399711:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968479232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541157.399786:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541157.399843:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b4da3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541157.400460:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479232 00000100:00100000:0.0:1788541157.400471:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479232 00000100:00100000:0.0:1788541157.400518:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541157.400527:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+11:14428:x1875420968479232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541157.400540:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541157.400554:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb5f expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541157.400580:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541157.400591:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541157.400616:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6600, rc 0) 00000100:00100000:0.0:1788541157.400671:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968479232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541157.400677:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788541157.400772:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968479232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541157.400787:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541157.400796:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541157.400847:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968479360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541157.400870:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541157.400904:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b4da3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541157.401450:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479360 00000100:00100000:2.0:1788541157.401465:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479360 00000100:00100000:2.0:1788541157.401490:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788541157.401496:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968479360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541157.402462:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968479360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 961us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541157.402473:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541157.405899:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968479360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541157.406007:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968479488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541157.408482:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541157.408540:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7b4da3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541157.408628:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479488 00000100:00100000:0.0:1788541157.408637:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479488 00000100:00100000:0.0:1788541157.408699:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541157.408709:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968479488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541157.408946:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:14428:x1875420968479488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541157.408955:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541157.409053:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968479488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788541157.410506:0:14924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788541157.411217:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788541157.411255:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541157.411266:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541157.411279:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541157.792595:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541158.807585:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541159.192152:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541159.831875:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541160.855653:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788541161.654181:0:15112:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788541161.654185:0:15112:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788541161.654313:0:15112:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d7901d2000 00000020:01000004:1.0:1788541161.654328:0:15112:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788541161.654341:0:15112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788541161.654356:0:15112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98d7890619c0) 00000020:00000080:1.0:1788541161.654384:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788541161.687271:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788541161.688061:0:15112:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788541161.697775:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788541161.698024:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788541161.698466:0:15112:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788541161.698849:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 497: rc = 0 00100000:10000000:1.0:1788541161.698979:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:1.0:1788541161.699067:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 497: rc = 0 00100000:10000000:1.0:1788541161.699624:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788541161.699888:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1788541161.704339:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1788541161.704723:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1788541161.704983:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788541161.705232:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00000020:00000080:1.0:1788541161.705826:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788541161.705844:0:15112:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788541161.705853:0:15112:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9a6a13d3cd1bb74 00000020:01000004:1.0:1788541161.705862:0:15112:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788541161.705882:0:15112:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788541161.705885:0:15112:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788541161.705891:0:15112:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788541161.705896:0:15112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788541161.705914:0:15112:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98d7af83cd40) 00000020:00000080:1.0:1788541161.705926:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788541161.706992:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541161.715642:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788541161.715657:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788541161.739851:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788541161.739865:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788541161.741355:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788541161.741366:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788541161.749640:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541161.749829:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788541161.749836:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788541161.752038:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788541161.752049:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788541161.801092:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541161.806663:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788541161.806674:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788541161.810579:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788541161.810594:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788541161.816849:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788541161.816865:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788541161.818914:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541161.819151:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788541161.819158:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788541161.821594:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788541161.821607:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1788541161.879660:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541161.881958:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541161.882199:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788541161.882207:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788541161.897499:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788541161.897520:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788541161.898993:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788541161.899037:0:15112:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788541161.899044:0:15112:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788541161.916580:0:15112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788541161.916616:0:15112:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.159@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788541161.916621:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788541161.916623:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788541161.916624:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541161.916625:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541161.916626:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541161.916628:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541161.916633:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541161.916634:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541161.916636:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541161.916639:0:15112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788541161.916641:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788541161.916642:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788541161.916643:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541161.916644:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541161.916645:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541161.916646:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541161.916647:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541161.916648:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541161.916649:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541161.916739:0:15112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788541161.916759:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968479616:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788541161.916821:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541161.916922:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d784d76540 going to sleep for 11 seconds 00000100:00100000:0.0:1788541161.916999:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479616 00000100:00100000:0.0:1788541161.917062:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479616 00000100:00100000:0.0:1788541161.917151:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541161.917162:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:15112:x1875420968479616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788541161.917204:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788541161.917208:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788541161.917212:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788541161.933838:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:15112:x1875420968479616:12345-0@lo:253:mount.lustre.0 Request processed in 16667us (17005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.933870:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541161.933984:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968479616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788541161.934001:0:15112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788541161.934004:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788541161.934005:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788541161.934006:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541161.934007:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541161.934009:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541161.934010:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541161.934012:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541161.934014:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541161.934016:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788541161.934035:0:15112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d7901d2000 from lustre-OST0000 10000000:01000000:1.0:1788541161.934059:0:15112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788541161.934062:0:15112:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788541161.934069:0:15112:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d789060000 local copy 00010000:00010000:1.0:1788541161.934079:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541161.934336:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968479744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541161.934547:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541161.935631:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7813700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541161.940649:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479744 00000100:00100000:2.0:1788541161.940667:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479744 00000100:00100000:3.0:1788541161.940855:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541161.940868:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:15112:x1875420968479744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541161.941189:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:15112:x1875420968479744:12345-0@lo:501:mount.lustre.0 Request processed in 323us (6641us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541161.941197:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788541161.941639:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968479744:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788541161.941664:0:15112:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788541161.941846:0:15112:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788541161.941855:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.941866:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541161.941895:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d7901d2000 10000000:01000000:2.0:1788541161.941906:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788541161.941910:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98d789060000 10000000:01000000:2.0:1788541161.941912:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788541161.941916:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98d789060000 from 1 10000000:01000000:2.0:1788541161.941919:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788541161.941957:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.941965:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.941974:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541161.941994:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968479872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541161.942041:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541161.942084:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78edb5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541161.942162:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968479872 00000100:00100000:0.0:1788541161.942169:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968479872 00000100:00100000:0.0:1788541161.942211:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541161.942220:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+12:15112:x1875420968479872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541161.942230:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541161.942244:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f7200/0xc9a6a13d3cd1bb89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb82 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541161.942294:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f7200/0xc9a6a13d3cd1bb89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb82 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541161.942306:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f7200/0xc9a6a13d3cd1bb89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb82 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541161.942315:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f7200, rc 0) 00000100:00100000:0.0:1788541161.942356:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+13:15112:x1875420968479872:12345-0@lo:101:mount.lustre.0 Request processed in 137us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.942362:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788541161.942571:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968479872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541161.942584:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb89 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.942592:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb89 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541161.942607:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788541161.942626:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb89 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.942633:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf602a00/0xc9a6a13d3cd1bb82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb89 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541161.942649:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788541161.942653:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541161.942658:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788541161.942660:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788541161.942676:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.942683:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.942690:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541161.942704:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541161.942731:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541161.942758:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78edb5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541161.943002:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480000 00000100:00100000:0.0:1788541161.943007:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480000 00000100:00100000:0.0:1788541161.943039:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541161.943047:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+13:15112:x1875420968480000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541161.943055:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541161.943064:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7912f6a00/0xc9a6a13d3cd1bb97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bb90 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541161.943080:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7912f6a00/0xc9a6a13d3cd1bb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb90 expref: 14 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541161.943098:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7912f6a00/0xc9a6a13d3cd1bb97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb90 expref: 14 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541161.943105:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7912f6a00, rc 0) 00000100:00100000:0.0:1788541161.943155:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480000:12345-0@lo:101:mount.lustre.0 Request processed in 108us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.943161:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788541161.943275:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541161.943299:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb97 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541161.943307:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bb97 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541161.944065:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788541161.946971:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541161.947271:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788541161.952709:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788541161.952760:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788541161.952830:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788541161.952866:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788541161.952894:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788541161.952970:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788541161.952992:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788541161.953101:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541161.953186:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541161.953234:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090300 going to sleep for 11 seconds 00000100:00100000:0.0:1788541161.955517:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480128 00000100:00100000:0.0:1788541161.955534:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480128 00000100:00100000:0.0:1788541161.955607:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541161.955618:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541161.956101:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480128:12345-0@lo:501:mount.lustre.0 Request processed in 484us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.956111:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541161.958755:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541161.958825:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541161.958915:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541161.958965:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541161.959038:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480256 00000100:00100000:1.0:1788541161.959046:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480256 00000100:00100000:1.0:1788541161.959102:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788541161.959112:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541161.960395:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480256:12345-0@lo:503:mount.lustre.0 Request processed in 1279us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541161.960442:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788541161.961620:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541161.965148:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541161.965269:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541161.966779:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541161.966835:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541161.966926:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480384 00000100:00100000:1.0:1788541161.966935:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480384 00000100:00100000:1.0:1788541161.967039:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788541161.967049:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541161.967355:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480384:12345-0@lo:502:mount.lustre.0 Request processed in 306us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541161.967363:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788541161.967571:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541161.967857:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788541161.967904:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788541161.967930:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788541161.967967:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788541161.967995:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788541161.968021:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788541161.968059:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788541161.968086:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788541161.968111:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788541161.968165:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788541161.968193:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788541161.968227:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788541161.968261:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541161.970531:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541161.973274:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090300 going to sleep for 11 seconds 00000100:00100000:0.0:1788541161.973762:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480512 00000100:00100000:0.0:1788541161.973776:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480512 00000100:00100000:0.0:1788541161.973836:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788541161.973847:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541161.974163:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480512:12345-0@lo:502:mount.lustre.0 Request processed in 316us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.974174:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788541161.974324:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541161.975097:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788541161.975130:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788541161.979066:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788541161.979080:0:15126:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788541161.979090:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541161.979093:0:15126:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788541161.979101:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541161.979129:0:15126:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98d7ae254d40) 00000020:00000080:3.0:1788541161.979151:0:15126:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788541161.979157:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788541161.979235:0:15126:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d7901d2000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788541161.979242:0:15126:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788541161.979252:0:15126:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc9a6a13d3cd1bba5 00010000:00010000:3.0:1788541161.990221:0:15126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788541161.990910:0:15126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788541162.006073:0:15126:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788541162.019583:0:15126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788541162.019600:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541162.019607:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.019609:0:15126:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788541162.019612:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788541162.019615:0:15126:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788541162.019616:0:15126:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541162.019617:0:15126:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541162.019619:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788541162.019621:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.019623:0:15126:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788541162.019625:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541162.019628:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.019635:0:15126:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788541162.019639:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788541162.019641:0:15126:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788541162.019643:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541162.019646:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.019647:0:15126:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788541162.019649:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541162.019651:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.019652:0:15126:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788541162.019656:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788541162.019719:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541162.019723:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.019725:0:15126:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788541162.019728:0:15126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788541162.024554:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788541162.024612:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788541162.024640:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb97 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.024654:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf603000/0xc9a6a13d3cd1bb90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bb97 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541162.024663:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7901d2000 from 1 10000000:01000000:2.0:1788541162.024666:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541162.024710:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.024719:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.024729:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541162.024755:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541162.024827:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.024872:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78edb5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541162.024949:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480640 00000100:00100000:1.0:1788541162.024957:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480640 00000100:00100000:1.0:1788541162.025010:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788541162.025020:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+14:15112:x1875420968480640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541162.025033:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541162.025045:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bbac expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541162.025069:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541162.025080:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541162.025097:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031200, rc 0) 00000100:00100000:1.0:1788541162.025152:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968480640:12345-0@lo:101:mount.lustre.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.025159:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541162.027170:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541162.027198:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.027211:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541162.027830:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788541162.028334:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541162.028683:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788541162.028928:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788541162.028994:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788541162.029003:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788541162.029091:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541162.029168:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.029219:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78edb5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541162.030458:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480768 00000100:00100000:3.0:1788541162.030469:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480768 00000100:00100000:3.0:1788541162.030527:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788541162.030537:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968480768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541162.030811:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968480768:12345-0@lo:501:mount.lustre.0 Request processed in 274us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.030819:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788541162.030989:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541162.031030:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541162.031070:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.031102:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d78edb5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541162.033459:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968480896 00000100:00100000:3.0:1788541162.033474:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968480896 00000100:00100000:3.0:1788541162.033535:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788541162.033547:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968480896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541162.033813:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968480896:12345-0@lo:503:mount.lustre.0 Request processed in 269us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.033821:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788541162.034043:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968480896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788541162.036012:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788541162.044186:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541162.044306:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.045962:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788541162.046047:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481024 00000100:00100000:3.0:1788541162.046057:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481024 00000100:00100000:1.0:1788541162.046214:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541162.046225:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968481024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541162.047870:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968481024:12345-0@lo:502:mount.lustre.0 Request processed in 1639us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.047883:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788541162.048018:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541162.048367:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788541162.048466:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788541162.048518:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788541162.048562:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788541162.048589:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788541162.048626:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788541162.048652:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788541162.048683:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788541162.048731:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541162.048787:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.049867:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788541162.049910:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481152 00000100:00100000:3.0:1788541162.049917:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481152 00000100:00100000:2.0:1788541162.050050:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788541162.050058:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968481152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541162.050275:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968481152:12345-0@lo:502:mount.lustre.0 Request processed in 216us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.050605:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541162.050766:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788541162.050783:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:2.0:1788541162.051736:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:01000000:3.0:1788541162.051946:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541162.051955:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.051958:0:15130:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788541162.051964:0:15130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d7901d2000 00000020:00000080:3.0:1788541162.051967:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541162.051973:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541162.051975:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.051977:0:15130:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788541162.051979:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541162.051981:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.051982:0:15130:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788541162.051985:0:15130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d7901d2000 00000020:00000080:3.0:1788541162.051987:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541162.052038:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541162.052041:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.052042:0:15130:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788541162.052044:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541162.052046:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.052048:0:15130:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541162.052051:0:15130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d7901d2000 00000020:00000080:3.0:1788541162.052053:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541162.052079:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541162.052081:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541162.052083:0:15130:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788541162.052085:0:15130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788541162.052222:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788541162.052252:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541162.052274:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.052652:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541162.052698:0:15112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788541162.052701:0:15112:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d7901d2000 10000000:01000000:2.0:1788541162.052703:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d7901d2000 10000000:01000000:2.0:1788541162.052707:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541162.052712:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d7901d2000 from 1 10000000:01000000:2.0:1788541162.052714:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788541162.052746:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.052754:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.052764:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541162.052786:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541162.052851:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.052890:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541162.052936:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481280 00000100:00100000:3.0:1788541162.052941:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481280 00000100:00100000:3.0:1788541162.052979:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788541162.052993:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968481280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541162.053005:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541162.053017:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cce00/0xc9a6a13d3cd1bbc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bbba expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541162.053038:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cce00/0xc9a6a13d3cd1bbc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbba expref: 16 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541162.053050:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cce00/0xc9a6a13d3cd1bbc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbba expref: 16 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541162.053060:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cce00, rc 0) 00000100:00100000:3.0:1788541162.053100:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481280:12345-0@lo:101:mount.lustre.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.053106:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788541162.056827:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541162.056859:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbc1 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.056872:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bbc1 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541162.057669:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788541162.058239:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541162.060810:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788541162.060878:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788541162.060916:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788541162.060968:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788541162.061002:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788541162.061045:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788541162.061082:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788541162.061127:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788541162.061190:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788541162.061218:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788541162.061243:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788541162.061279:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788541162.061327:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788541162.061360:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788541162.067580:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788541162.067688:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788541162.067725:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788541162.067777:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788541162.067816:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788541162.067852:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788541162.067913:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788541162.067950:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788541162.067984:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788541162.068029:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788541162.068083:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788541162.073169:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788541162.073332:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788541162.073381:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788541162.073501:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788541162.073509:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788541162.073622:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541162.073692:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.073736:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541162.074597:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481408 00000100:00100000:1.0:1788541162.074607:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481408 00000100:00100000:1.0:1788541162.074654:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541162.074663:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541162.074935:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481408:12345-0@lo:501:mount.lustre.0 Request processed in 272us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.074943:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541162.074998:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541162.075040:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541162.075084:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541162.075105:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481536 00000100:00100000:1.0:1788541162.075109:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481536 00000100:00100000:1.0:1788541162.075140:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788541162.075146:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541162.075266:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481536:12345-0@lo:503:mount.lustre.0 Request processed in 119us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.075292:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788541162.075330:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541162.075341:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541162.085210:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541162.085335:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541162.085438:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541162.085491:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481664 00000100:00100000:1.0:1788541162.085497:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481664 00000100:00100000:1.0:1788541162.085532:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788541162.085540:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541162.085748:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481664:12345-0@lo:502:mount.lustre.0 Request processed in 207us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.085755:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788541162.085812:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541162.085833:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541162.086085:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788541162.086143:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788541162.086173:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788541162.086210:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788541162.086238:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788541162.086276:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788541162.086308:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788541162.086334:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788541162.086370:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788541162.086399:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788541162.086454:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788541162.086492:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788541162.086530:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788541162.086555:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788541162.086594:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788541162.086637:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788541162.086670:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788541162.086720:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788541162.086754:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788541162.086785:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788541162.086833:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788541162.086871:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788541162.086902:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788541162.086952:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788541162.086988:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788541162.087020:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788541162.087082:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788541162.087139:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788541162.087175:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788541162.087236:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788541162.087273:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788541162.087319:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788541162.087352:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788541162.087397:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788541162.087462:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788541162.087512:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788541162.087550:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788541162.087580:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788541162.087625:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788541162.087657:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788541162.087704:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541162.087774:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541162.087828:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481792 00000100:00100000:1.0:1788541162.087835:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481792 00000100:00100000:1.0:1788541162.087884:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788541162.087892:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541162.088091:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968481792:12345-0@lo:502:mount.lustre.0 Request processed in 199us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.088099:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788541162.102488:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541162.102538:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968481792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541162.102709:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788541162.102728:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788541162.121976:0:15135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788541162.121997:0:15135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98d78994cd40) 00000020:00000080:2.0:1788541162.122023:0:15135:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788541162.122137:0:15135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d7901d2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788541162.122142:0:15135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d7901d2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788541162.122144:0:15135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d7901d2000 3 00010000:00080000:2.0:1788541162.122178:0:15135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7bbafc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.159@tcp at head 00010000:00010000:2.0:1788541162.127193:0:15135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788541162.128351:0:15135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788541162.128391:0:15135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788541162.128404:0:15135:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc9a6a13d3cd1bbcf 00000100:00080000:2.0:1788541162.128430:0:15135:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541162.128437:0:15135:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98d7bbafc800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1788541162.128474:0:15135:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d682927b80 x1875420968481920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541162.128507:0:15135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788541162.128962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875420968481920:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541162.129034:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541162.131474:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541162.131485:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541162.131487:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541162.131491:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541162.131580:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968482048:0@lo:400:kworker.0 00000100:00100000:3.0:1788541162.131643:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541162.131705:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968481920 00000100:00100000:3.0:1788541162.131713:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968481920 00000100:00100000:3.0:1788541162.131744:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482048 00000100:00100000:3.0:1788541162.131753:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482048 00000100:00100000:3.0:1788541162.131781:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541162.131789:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968482048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541162.131834:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968482048:12345-0@lo:400:kworker.0 Request processed in 45us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.131840:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541162.131856:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541162.131861:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1875420968481920:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788541162.131883:0:14430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:3.0:1788541162.131919:0:14430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc9a6a13d3cd1bbd6 00000004:00100000:3.0:1788541162.131933:0:14430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788541162.131962:0:14430:0:(import.c:65:import_set_state_nolock()) ffff98d7899d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541162.131997:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875420968481920:12345-0@lo:38:llog_process_th.0 Request processed in 135us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.132003:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788541162.132040:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d7b2f30e00 x1875420968482048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541162.132053:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968482048:0@lo:400:kworker.0 00010000:00080000:3.0:1788541162.132079:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98d682927b80 x1875420968481920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541162.132087:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541162.132093:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788541162.132100:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788541162.132104:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788541162.132106:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7bbafc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788541162.140620:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1875420968481920:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788541162.143739:0:15135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788541162.151892:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788541162.153236:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788541162.153802:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbc1 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541162.153817:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf602600/0xc9a6a13d3cd1bbba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbc1 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788541162.154655:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788541162.154659:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788541162.154660:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541162.154662:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541162.154663:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541162.154665:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541162.154667:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788541162.154669:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541162.154670:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541162.154675:0:15112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788541162.154678:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788541162.154679:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788541162.154680:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541162.154681:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541162.154682:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541162.154684:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541162.154685:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788541162.154686:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541162.154687:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541162.154716:0:15112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788541162.154740:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968482176:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788541162.154814:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541162.154850:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bfa3f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541162.158779:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482176 00000100:00100000:1.0:1788541162.158798:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482176 00000100:00100000:1.0:1788541162.158885:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541162.158897:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15112:x1875420968482176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788541162.158946:0:14426:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788541162.158961:0:14426:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788541162.244925:0:14426:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788541162.244951:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788541162.245201:0:14446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788541162.245219:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788541162.245242:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.245261:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.245270:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.245312:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541162.245327:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 16 pid: 14426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541162.245341:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1875420968482304:0@lo:104: 00000100:00100000:2.0:1788541162.245859:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541162.245919:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541162.245981:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482304 00000100:00100000:1.0:1788541162.245990:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482304 00000100:00100000:1.0:1788541162.246049:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541162.246058:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14446:x1875420968482304:12345-0@lo:104: 00010000:00010000:1.0:1788541162.246071:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541162.246141:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541162.246155:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14446:x1875420968482304:12345-0@lo:104: Request processed in 99us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541162.246163:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788541162.246183:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541162.246191:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246199:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541162.246202:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246211:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541162.246218:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541162.246230:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788541162.246309:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1875420968482304:0@lo:104: 00010000:00010000:0.0:1788541162.246311:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246317:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541162.246329:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246345:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246352:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d780031600/0xc9a6a13d3cd1bb43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb4a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246380:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541162.246382:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541162.246383:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541162.246395:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541162.246405:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e59d638-365e-4b5a-a31c-1933ab9279a7:3315:1875420968482432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541162.246473:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541162.246509:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482432 00000100:00100000:0.0:1788541162.246513:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482432 00010000:00010000:0.0:1788541162.246533:0:14418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 17 pid: 14426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541162.246564:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541162.246572:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:3315:x1875420968482432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541162.246582:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541162.246588:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 17 pid: 14426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246599:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 17 pid: 14426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246619:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7912f7e00/0xc9a6a13d3cd1bb4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb43 expref: 17 pid: 14426 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246632:0:14418:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246639:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788541162.246667:0:14418:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001448901s 00010000:00010000:0.0:1788541162.246673:0:14418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246680:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246687:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246694:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246699:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541162.246703:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246710:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541162.246763:0:14446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246763:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541162.246772:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541162.246777:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541162.246778:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7bf602e00/0xc9a6a13d3cd1bbdd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541162.246820:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:3315:x1875420968482432:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541162.246828:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541162.246982:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e59d638-365e-4b5a-a31c-1933ab9279a7:3315:1875420968482432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541162.286302:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:15112:x1875420968482176:12345-0@lo:253:mount.lustre.0 Request processed in 127397us (131476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541162.286319:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788541162.286616:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15112:1875420968482176:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788541162.286633:0:15112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788541162.286637:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788541162.286638:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788541162.286640:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541162.286641:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541162.286643:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541162.286644:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541162.286645:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788541162.286647:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541162.286648:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788541162.287772:0:15112:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788541162.294121:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788541162.294297:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788541162.294636:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788541162.294891:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788541162.295175:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788541162.297741:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788541162.299341:0:15112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788541162.380093:0:15112:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788541162.380104:0:15112:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788541162.380175:0:15112:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788541162.380230:0:15112:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788541162.380249:0:15112:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788541162.380288:0:15112:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788541162.905620:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541163.931596:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788541164.121255:0:14428:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788541164.121547:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d682549800 from 7 10000000:01000000:3.0:1788541164.121553:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788541164.121603:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541164.121615:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541164.121628:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541164.123161:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968482560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541164.123241:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541164.123776:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bbae5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541164.129647:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482560 00000100:00100000:2.0:1788541164.130020:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482560 00000100:00100000:3.0:1788541164.136432:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541164.136457:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+15:14428:x1875420968482560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541164.136480:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541164.136503:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bbe4 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541164.136536:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 16 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541164.136549:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 16 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541164.136560:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc400, rc 0) 00000100:00100000:3.0:1788541164.136655:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:14428:x1875420968482560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (13413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541164.136662:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541164.136762:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968482560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541164.136784:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541164.136794:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541164.136877:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968482688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788541164.137163:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541164.148622:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482688 00000100:00100000:1.0:1788541164.148645:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482688 00000100:00100000:1.0:1788541164.148733:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788541164.148744:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:14428:x1875420968482688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788541164.148779:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788541164.148805:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788541164.148808:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788541164.148978:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:14428:x1875420968482688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 235us (11814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541164.148987:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788541164.149154:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541164.149179:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968482688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788541164.149253:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541164.149996:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541164.150011:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541164.956334:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541165.976265:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541167.000318:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541167.576118:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541167.576126:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541167.576129:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541167.576141:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541167.576180:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541167.576201:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968482816:0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.576284:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541167.576478:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.576506:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541167.576528:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541167.576534:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968483072:0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.576558:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541167.576590:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482816 00000100:00100000:1.0:1788541167.576599:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482816 00000100:00100000:1.0:1788541167.576644:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541167.576653:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:3314:x1875420968482816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.576701:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:3314:x1875420968482816:12345-0@lo:400:kworker.0 Request processed in 49us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541167.576838:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541167.577373:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968482944 00000100:00100000:1.0:1788541167.577379:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968482944 00000100:00100000:1.0:1788541167.577426:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483072 00000100:00100000:1.0:1788541167.577429:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483072 00000100:00100000:1.0:1788541167.577456:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541167.577463:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968482944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.577509:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968482944:12345-0@lo:400:kworker.0 Request processed in 46us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541167.577515:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541167.577527:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541167.577543:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968483072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.577571:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968483072:12345-0@lo:400:kworker.0 Request processed in 30us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541167.577577:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788541167.577623:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7adc29f80 x1875420968483072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541167.577637:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968483072:0@lo:400:kworker.0 00010000:00080000:1.0:1788541167.577648:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7adc28380 x1875420968482944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541167.577656:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788541167.577690:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968482816:0@lo:400:kworker.0 00000100:00080000:3.0:1788541167.578122:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788541168.026175:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541169.047536:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541169.433683:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788541170.074292:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541170.344729:0:15481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788541171.095557:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.119645:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541172.380360:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541157/real 1788541157] req@ffff98d7bf4c4e00 x1875420968478848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541172.380392:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d7bf4c4e00 x1875420968478848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541172.380401:0:3313:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541157/real 1788541157] req@ffff98d7bf4c7480 x1875420968478976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541172.380446:0:3313:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff98d7bf4c7480 x1875420968478976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541172.380467:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4007800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541172.380487:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788541172.380491:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968478848:0@lo:8:kworker.0 00000100:00080000:3.0:1788541172.380497:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541172.380503:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788541172.380505:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968478976:0@lo:8:kworker.0 00000100:00080000:3.0:1788541172.380571:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541172.380575:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541172.380577:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7b4007800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541172.380594:0:13994:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:3.0:1788541172.380599:0:13994:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788541172.380605:0:13994:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98d7b4007800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1788541172.380625:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7b2f30000 x1875420968483328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541172.380637:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541172.380640:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541172.380642:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541172.380645:0:13994:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 442 00000100:00080000:3.0:1788541172.380647:0:13994:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788541172.380651:0:13994:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d7b4003800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1788541172.380661:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7b2f33b80 x1875420968483456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541172.380730:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.380797:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541172.380841:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541172.380847:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.380871:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541172.380900:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.380921:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541172.380952:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483200 00000100:00100000:3.0:1788541172.380960:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483200 00000100:00100000:3.0:1788541172.381001:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788541172.381010:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:3314:x1875420968483200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.381068:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:3314:x1875420968483200:12345-0@lo:400:kworker.0 Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541172.381075:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788541172.381119:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483584 00000100:00100000:3.0:1788541172.381123:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483584 00000100:00100000:3.0:1788541172.381146:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483712 00000100:00100000:3.0:1788541172.381148:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483712 00000100:00100000:3.0:1788541172.381173:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541172.381179:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968483584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.381220:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968483584:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541172.381227:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541172.382767:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541172.382788:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968483712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.382890:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968483712:12345-0@lo:400:kworker.0 Request processed in 111us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541172.382899:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788541172.382939:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788541172.382977:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7b2f33480 x1875420968483712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541172.382993:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968483712:0@lo:400:kworker.0 00010000:00080000:3.0:1788541172.383044:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7b2f30700 x1875420968483584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541172.383055:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968483584:0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.383068:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788541172.387106:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968483328:0@lo:8:kworker.0 00000100:00100000:3.0:1788541172.387183:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541172.387234:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968483456:0@lo:8:kworker.0 00000100:00100000:3.0:1788541172.387259:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541172.388771:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483328 00000100:00100000:0.0:1788541172.388789:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483328 00000100:00100000:0.0:1788541172.388828:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483456 00000100:00100000:0.0:1788541172.388832:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483456 00000100:00100000:0.0:1788541172.388850:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541172.388860:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875420968483328:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788541172.388894:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1788541172.388924:0:15114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1bbf2 00002000:00100000:0.0:1788541172.388939:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98d7b5264000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788541172.388943:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788541172.388946:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788541172.389331:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788541172.389359:0:15114:0:(import.c:65:import_set_state_nolock()) ffff98d7b5263000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541172.389482:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875420968483328:12345-0@lo:8:kworker.0 Request processed in 622us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541172.389491:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541172.389508:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541172.389513:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875420968483456:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788541172.389526:0:15114:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788541172.389554:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875420968483456:12345-0@lo:8:kworker.0 Request processed in 40us (2294us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541172.389560:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788541172.389628:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7b2f30000 x1875420968483328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541172.389641:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541172.389650:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788541172.389657:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788541172.389662:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788541172.389665:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4007800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788541172.389685:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788541172.389690:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968483328:0@lo:8:kworker.0 00000100:00080000:0.0:1788541172.389705:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541172.389709:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541172.389712:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968483456:0@lo:8:kworker.0 00000004:00080000:0.0:1788541172.389775:0:14453:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788541172.389793:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1875420968483968:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788541172.389833:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541172.389851:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541172.389863:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541172.389885:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541172.389913:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483840 00000100:00100000:0.0:1788541172.389917:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483840 00000100:00100000:0.0:1788541172.389947:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541172.389953:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968483840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541172.389974:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541172.390005:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968483840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541172.390010:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788541172.390033:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541172.390049:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7bf4c4380 x1875420968483840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541172.390065:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968483840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541172.390080:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968483968 00000100:00100000:0.0:1788541172.390083:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968483968 00000100:00100000:0.0:1788541172.390100:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541172.390105:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14453:x1875420968483968:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788541172.393508:0:14452:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788541172.393817:0:14452:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 457393407785ns, next at 0ns, rc = 0 00002000:00080000:1.0:1788541172.400945:0:15114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788541172.400960:0:15114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788541172.400965:0:15114:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788541172.415282:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541172.415294:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.415311:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1788541172.415316:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541172.415323:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.415567:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.415580:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.415589:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.415610:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541172.415691:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541172.415701:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541172.415711:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541172.415716:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541172.415739:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541172.415759:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541172.415767:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfc8913d/0xc9a6a13d3cd1bbf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541172.415791:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541172.415793:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541172.415796:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541172.421790:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541172.421805:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.421822:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1788541172.421826:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541172.421833:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.421847:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.421857:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.421878:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.422082:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541172.422098:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.422104:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.422113:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.422118:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.422127:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.422143:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.422150:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdca637c/0xc9a6a13d3cd1bc00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.422169:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.422171:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.422173:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.424902:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.424918:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.424935:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.424939:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.424953:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.424968:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.424978:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.424984:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.425005:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.425032:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.425038:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.425045:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.425050:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.425058:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.425076:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.425094:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.425110:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.425112:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.425114:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.426844:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.426861:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.426881:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.426886:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.426895:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.426910:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.426919:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.426927:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.426952:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541172.428671:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.428696:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.428710:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7a00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.428716:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.428728:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.428748:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.428757:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.428781:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.428784:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.428787:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.428892:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.428905:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.428917:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.428921:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.428927:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.428939:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.428947:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.428955:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.428983:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541172.429055:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.429061:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.429070:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.429074:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.429096:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.429109:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.429117:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.429133:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.429135:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.429137:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.430945:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.430957:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.430969:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.430973:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.430980:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.430992:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.431009:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.431017:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433141:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541172.433832:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.433842:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433856:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.433860:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.433866:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433881:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433892:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433901:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433929:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541172.433945:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541172.433953:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433962:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.433966:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433978:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.433994:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434003:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434032:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.434035:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434042:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.434046:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434065:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434075:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434082:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434095:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.434096:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.434098:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.434713:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.434720:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434729:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.434732:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.434736:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434745:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434754:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434767:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434782:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.434793:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.434796:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434803:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.434807:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434814:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434825:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434832:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.434846:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.434848:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.434850:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.435252:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.435264:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435272:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.435276:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.435280:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435289:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435297:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435304:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435319:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.435328:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.435331:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435338:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.435341:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435349:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435367:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435375:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435388:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.435389:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.435390:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.435812:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.435817:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435826:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.435829:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.435833:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435843:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435850:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435857:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435881:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.435889:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.435893:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435899:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.435903:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435910:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435923:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435931:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4cf074e/0xc9a6a13d3cd1bc38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.435943:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.435945:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.435947:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.436499:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.454854:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.454868:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.454885:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.454896:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.454904:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.454920:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.454931:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.454939:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.454962:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.454975:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.454981:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.454989:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.454994:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455003:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455033:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455055:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006feb2161/0xc9a6a13d3cd1bc3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455072:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.455075:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.455077:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.455498:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.455505:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455513:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.455516:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.455520:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455529:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455537:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455544:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455562:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.455570:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.455580:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455587:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.455590:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455598:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455610:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455617:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c298a94e/0xc9a6a13d3cd1bc46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.455630:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.455632:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.455634:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.456015:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.456034:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456043:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.456046:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.456050:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456070:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456079:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456086:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456099:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.456108:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.456112:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456118:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.456121:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456129:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456140:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456148:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005293352d/0xc9a6a13d3cd1bc4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456169:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.456170:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.456172:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.456573:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.456579:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456587:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.456590:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.456594:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456603:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456610:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456616:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456633:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.456641:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.456644:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456660:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.456665:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456672:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456684:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456691:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4d0fd4e/0xc9a6a13d3cd1bc54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.456705:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.456706:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.456708:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.464892:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.464913:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.464936:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.464941:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.464948:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.464965:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.464985:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.464994:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.465016:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.465072:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.465079:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.465087:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.465092:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.465102:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.465119:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.465128:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2706d2/0xc9a6a13d3cd1bc5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.465147:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.465155:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.465157:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.466131:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.466139:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466151:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.466154:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.466160:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466171:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466181:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466189:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466213:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.466225:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.466229:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466244:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.466248:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466269:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466282:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466288:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e52ff57d/0xc9a6a13d3cd1bc62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.466304:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.466306:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.466307:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.468810:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.468824:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.468843:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.468848:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.468855:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.468871:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.468879:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.468891:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.468914:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541172.469104:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.469114:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.469124:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.469130:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.469141:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.469171:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541172.469326:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.469333:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.469342:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.469345:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.469350:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.469360:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.469369:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.469377:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.469397:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.469433:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.469790:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e229dbfd/0xc9a6a13d3cd1bc69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.469813:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.469816:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.469818:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.469980:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.469992:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470000:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.470003:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.470007:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470016:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.470118:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.470121:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.470123:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.470400:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470528:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470542:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470549:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.470554:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470564:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470592:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470601:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddae0b7f/0xc9a6a13d3cd1bc70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.470617:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.470619:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.470621:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.470642:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541172.471180:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.471187:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541172.471198:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788541172.471198:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.471205:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.471211:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.471222:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.471230:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.471238:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.471261:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788541172.471318:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541172.471326:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.471335:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f6e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.471339:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.471347:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.471359:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.471367:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff197976/0xc9a6a13d3cd1bc77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.471393:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.471396:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.471403:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.471406:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541172.471981:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.471988:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.471997:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.472001:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.472006:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472016:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472036:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472044:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472060:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541172.472070:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541172.472074:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472082:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541172.472092:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472101:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472112:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472119:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dca52ef2/0xc9a6a13d3cd1bc85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.472132:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.472134:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.472135:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.472143:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.475961:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.476013:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.476031:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d796ac6/0xc9a6a13d3cd1bc7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.476063:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.476066:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.476070:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.476585:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.476594:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.476608:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.476613:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.476619:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.476633:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.476654:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.476662:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.476689:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541172.477589:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.477599:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.477611:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.477615:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.477621:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.477632:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.477641:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.477649:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.477682:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788541172.478062:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541172.478072:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478081:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7912f7a00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.478093:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478104:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478122:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478130:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032be2c8a/0xc9a6a13d3cd1bc8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478151:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.478166:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478173:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.478176:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478191:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478202:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478208:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d984f0e5/0xc9a6a13d3cd1bc93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.478226:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.478228:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.478230:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.478444:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.478820:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.478828:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.478839:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.478843:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.478848:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.478859:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.478867:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.478874:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.478902:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541172.479638:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.479648:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.479659:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.479669:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.479675:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.479684:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.479692:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.479699:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.479726:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788541172.479829:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541172.479838:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479848:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.479853:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479863:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479881:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479889:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b699074/0xc9a6a13d3cd1bc9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479908:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.479912:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479920:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161e00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.479930:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479938:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479951:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479959:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2d08394/0xc9a6a13d3cd1bca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.479978:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.479980:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.479982:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541172.480168:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.481384:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.481395:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.481996:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.482005:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.482013:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482041:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482053:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482071:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482139:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541172.482685:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.482691:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482702:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.482705:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.482709:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482718:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482726:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.482733:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483120:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541172.483131:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483141:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.483145:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483154:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483170:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483187:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4c2fbc7/0xc9a6a13d3cd1bca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483205:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541172.483208:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483214:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541172.483218:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483225:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483234:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541172.483241:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.483243:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541172.483245:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541172.483282:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788541172.483287:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000316b982e/0xc9a6a13d3cd1bcaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.483321:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541172.483969:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788541172.483976:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.483987:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1788541172.483991:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541172.483996:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.484006:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.484015:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.484036:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541172.484058:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541172.484172:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541172.484180:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541172.484190:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541172.484196:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541172.484205:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541172.484223:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788541172.484232:0:15114:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:2.0:1788541172.484241:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7a77b1/0xc9a6a13d3cd1bcb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541172.484260:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541172.484262:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541172.484264:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541172.484336:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14453:x1875420968483968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 94225us (94498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541172.484467:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1875420968483968:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788541172.484481:0:14453:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788541172.484529:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1875420968484096:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788541172.484572:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541172.484619:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7909f7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541172.484697:0:15116:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788541172.484706:0:15116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788541172.484967:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484096 00000100:00100000:3.0:1788541172.484974:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484096 00000100:00100000:0.0:1788541172.485533:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541172.494451:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541172.494475:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14453:x1875420968484096:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788541172.494653:0:15116:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788541172.510918:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14453:x1875420968484096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16444us (26337us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788541172.510942:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788541172.511003:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1875420968484096:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788541172.511032:0:14453:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:3.0:1788541172.766038:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788541172.766094:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788541173.148087:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541174.168120:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541175.193463:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541176.216035:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788541177.087801:0:15833:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788541177.087804:0:15833:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788541177.087890:0:15833:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98d786415800 00000020:01000004:1.0:1788541177.087902:0:15833:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788541177.087912:0:15833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788541177.087935:0:15833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98d7af8399c0) 00000020:00000080:1.0:1788541177.087947:0:15833:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788541177.108942:0:15833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788541177.110250:0:15833:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788541177.110835:0:15833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788541177.111035:0:15833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788541177.111221:0:15833:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788541177.111513:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 561: rc = 0 00100000:10000000:0.0:1788541177.111676:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 561: rc = 0 00100000:10000000:0.0:1788541177.111754:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 561: rc = 0 00100000:10000000:0.0:1788541177.113058:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 176: rc = 0 00100000:10000000:0.0:1788541177.113286:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 176: rc = 0 00100000:10000000:0.0:1788541177.114681:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 176: rc = 0 00100000:10000000:0.0:1788541177.114954:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 176: rc = 0 00100000:10000000:0.0:1788541177.115236:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 176: rc = 0 00100000:10000000:0.0:1788541177.115549:0:15833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 176: rc = 0 00000020:00000080:0.0:1788541177.116109:0:15833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788541177.116122:0:15833:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788541177.116133:0:15833:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9a6a13d3cd1bcc4 00000020:01000004:0.0:1788541177.116140:0:15833:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788541177.116162:0:15833:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788541177.116165:0:15833:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788541177.116171:0:15833:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788541177.116204:0:15833:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788541177.116209:0:15833:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788541177.129124:0:15833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.159@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788541177.131517:0:15833:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.159@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788541177.131525:0:15833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788541177.131526:0:15833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541177.131528:0:15833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541177.131529:0:15833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541177.131530:0:15833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541177.131531:0:15833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541177.131532:0:15833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541177.131534:0:15833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541177.131536:0:15833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541177.131540:0:15833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788541177.131542:0:15833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788541177.131543:0:15833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541177.131544:0:15833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541177.131545:0:15833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541177.131546:0:15833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541177.131548:0:15833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541177.131548:0:15833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541177.131549:0:15833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541177.131551:0:15833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541177.131595:0:15833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788541177.131617:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788541177.131702:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.131758:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d789631600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541177.131768:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484224 00000100:00100000:3.0:1788541177.131775:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484224 00000100:00100000:3.0:1788541177.131837:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788541177.131847:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15833:x1875420968484224:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788541177.131885:0:14425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788541177.131888:0:14425:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788541177.131892:0:14425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788541177.144325:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15833:x1875420968484224:12345-0@lo:253:mount.lustre.0 Request processed in 12471us (12613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.144352:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788541177.144460:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788541177.144475:0:15833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788541177.144478:0:15833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788541177.144480:0:15833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541177.144481:0:15833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541177.144482:0:15833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541177.144483:0:15833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541177.144484:0:15833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541177.144485:0:15833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541177.144493:0:15833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541177.144495:0:15833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788541177.144515:0:15833:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98d786415800 from lustre-OST0001 10000000:01000000:1.0:1788541177.144538:0:15833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788541177.144541:0:15833:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788541177.144549:0:15833:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98d789060000 local copy 00010000:00010000:1.0:1788541177.144559:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541177.144861:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541177.144900:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.145001:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782bdee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541177.145103:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484352 00000100:00100000:3.0:1788541177.145111:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484352 00000100:00100000:3.0:1788541177.145283:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788541177.145295:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15833:x1875420968484352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541177.145490:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15833:x1875420968484352:12345-0@lo:501:mount.lustre.0 Request processed in 197us (589us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541177.145498:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788541177.145583:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484352:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788541177.145598:0:15833:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788541177.145996:0:15833:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788541177.146005:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.146015:0:15833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cde00/0xc9a6a13d3cd1ba6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1ba71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541177.146040:0:15833:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98d786415800 10000000:01000000:1.0:1788541177.146044:0:15833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788541177.146049:0:15833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788541177.146052:0:15833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788541177.146056:0:15833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788541177.146059:0:15833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788541177.146084:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.146103:0:15833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.146112:0:15833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541177.146129:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541177.146172:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.146364:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782bdee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541177.146528:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484480 00000100:00100000:2.0:1788541177.146534:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484480 00000100:00100000:2.0:1788541177.146566:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788541177.146575:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:15833:x1875420968484480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541177.146586:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541177.146598:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf603600/0xc9a6a13d3cd1bcd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bccb expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541177.146620:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf603600/0xc9a6a13d3cd1bcd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bccb expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541177.146655:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf603600/0xc9a6a13d3cd1bcd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bccb expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541177.146665:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603600, rc 0) 00000100:00100000:2.0:1788541177.146743:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484480:12345-0@lo:101:mount.lustre.0 Request processed in 168us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541177.146750:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788541177.146907:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541177.146921:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcd2 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.146930:0:15833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bcd2 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541177.147624:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788541177.148831:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541177.149120:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788541177.149343:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788541177.149385:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788541177.149530:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788541177.149572:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788541177.149602:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788541177.149771:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788541177.149781:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788541177.149875:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541177.149938:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.150046:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d799b7bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.150117:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484608 00000100:00100000:0.0:1788541177.150124:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484608 00000100:00100000:2.0:1788541177.150265:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788541177.150276:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484608:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541177.150708:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484608:12345-0@lo:501:mount.lustre.0 Request processed in 356us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541177.150717:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788541177.150840:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541177.150878:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541177.150918:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.150950:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d799b7bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541177.151020:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484736 00000100:00100000:3.0:1788541177.151026:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484736 00000100:00100000:3.0:1788541177.151059:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788541177.151066:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541177.151394:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484736:12345-0@lo:503:mount.lustre.0 Request processed in 326us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541177.151401:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788541177.151594:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484736:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541177.152483:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541177.152561:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541177.152622:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.152724:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d799b7bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541177.152834:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484864 00000100:00100000:2.0:1788541177.152842:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484864 00000100:00100000:2.0:1788541177.152877:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788541177.152885:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541177.153096:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484864:12345-0@lo:502:mount.lustre.0 Request processed in 210us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541177.153104:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788541177.153277:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541177.153575:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788541177.153786:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788541177.153839:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788541177.153893:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788541177.153932:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788541177.153969:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788541177.154042:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788541177.154082:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788541177.154132:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788541177.154294:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541177.154358:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.154465:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d799b7bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.154551:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968484992 00000100:00100000:0.0:1788541177.154558:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968484992 00000100:00100000:0.0:1788541177.154590:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788541177.154599:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541177.154809:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968484992:12345-0@lo:502:mount.lustre.0 Request processed in 210us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.154817:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788541177.155000:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968484992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541177.155080:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788541177.155093:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788541177.156222:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541177.156232:0:15834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788541177.156239:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.156241:0:15834:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788541177.156246:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541177.156262:0:15834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98d7af838000) 00000020:00000080:1.0:1788541177.156285:0:15834:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788541177.156290:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788541177.156352:0:15834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d786415800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788541177.156359:0:15834:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788541177.156366:0:15834:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc9a6a13d3cd1bce0 00010000:00010000:1.0:1788541177.160846:0:15834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788541177.161393:0:15834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788541177.163299:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788541177.165820:0:15834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788541177.165833:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541177.165839:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.165841:0:15834:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788541177.165844:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541177.165849:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.165850:0:15834:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788541177.165853:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788541177.165854:0:15834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788541177.165857:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541177.165859:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.165860:0:15834:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788541177.165862:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541177.165864:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.165865:0:15834:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788541177.165869:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788541177.165932:0:15834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541177.165936:0:15834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.165937:0:15834:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788541177.165946:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788541177.166279:0:15833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788541177.166304:0:15833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788541177.166330:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcd2 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.166343:0:15833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d780031e00/0xc9a6a13d3cd1bccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcd2 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541177.166351:0:15833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d786415800 from 1 10000000:01000000:0.0:1788541177.166354:0:15833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541177.166395:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.166405:0:15833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.166445:0:15833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541177.166482:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541177.166552:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.166605:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519240 going to sleep for 11 seconds 00000100:00100000:3.0:1788541177.166751:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485120 00000100:00100000:3.0:1788541177.166759:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485120 00000100:00100000:3.0:1788541177.166814:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788541177.166826:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:15833:x1875420968485120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541177.166840:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541177.166855:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bce7 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.166879:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.166900:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.166908:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd000, rc 0) 00000100:00100000:3.0:1788541177.166953:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485120:12345-0@lo:101:mount.lustre.0 Request processed in 129us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541177.166959:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788541177.167069:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541177.167084:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.167094:0:15833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541177.167878:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788541177.169458:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541177.169780:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788541177.169833:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788541177.169897:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788541177.169906:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788541177.170006:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541177.170075:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.170115:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.170382:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485248 00000100:00100000:0.0:1788541177.170391:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485248 00000100:00100000:0.0:1788541177.170469:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541177.170479:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541177.170813:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485248:12345-0@lo:501:mount.lustre.0 Request processed in 334us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.170821:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788541177.170940:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541177.170984:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541177.171024:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.171045:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.171094:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485376 00000100:00100000:0.0:1788541177.171101:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485376 00000100:00100000:0.0:1788541177.171131:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541177.171138:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541177.171432:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485376:12345-0@lo:503:mount.lustre.0 Request processed in 271us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.171440:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788541177.171549:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541177.172133:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541177.172287:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541177.172334:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.172453:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.177318:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485504 00000100:00100000:0.0:1788541177.177333:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485504 00000100:00100000:1.0:1788541177.177554:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788541177.177566:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541177.177913:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485504:12345-0@lo:502:mount.lustre.0 Request processed in 348us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541177.177921:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788541177.178049:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541177.178359:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788541177.178445:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788541177.178488:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788541177.178516:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788541177.178542:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788541177.178577:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788541177.178604:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788541177.178629:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788541177.178804:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541177.178856:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.178893:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541177.178990:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485632 00000100:00100000:1.0:1788541177.178997:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485632 00000100:00100000:1.0:1788541177.179027:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788541177.179040:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541177.179190:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485632:12345-0@lo:502:mount.lustre.0 Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541177.179197:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788541177.179323:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541177.179442:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788541177.179451:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788541177.187077:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541177.187090:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.187093:0:15838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788541177.187100:0:15838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d786415800 00000020:00000080:1.0:1788541177.187103:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541177.187110:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541177.187113:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.187114:0:15838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788541177.187116:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541177.187118:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.187120:0:15838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788541177.187123:0:15838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98d786415800 00000020:00000080:1.0:1788541177.187125:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541177.187263:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541177.187268:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.187269:0:15838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788541177.187271:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541177.187274:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.187275:0:15838:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541177.187278:0:15838:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff98d786415800 00000020:00000080:1.0:1788541177.187280:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541177.187317:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541177.187320:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541177.187321:0:15838:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788541177.187325:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788541177.187520:0:15833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788541177.187556:0:15833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541177.187579:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.187592:0:15833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541177.187744:0:15833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788541177.187747:0:15833:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98d786415800 10000000:01000000:3.0:1788541177.187750:0:15833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98d786415800 10000000:01000000:3.0:1788541177.187754:0:15833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541177.187760:0:15833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98d786415800 from 1 10000000:01000000:3.0:1788541177.187762:0:15833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788541177.187808:0:15833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.187817:0:15833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.187829:0:15833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541177.187873:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541177.187943:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541177.188851:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d798090300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541177.192570:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485760 00000100:00100000:1.0:1788541177.192585:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485760 00000100:00100000:1.0:1788541177.192759:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788541177.192780:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968485760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541177.192797:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541177.192816:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1bcfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bcf5 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.192844:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1bcfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bcf5 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.192856:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031c00/0xc9a6a13d3cd1bcfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bcf5 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.192864:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031c00, rc 0) 00000100:00100000:1.0:1788541177.200206:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968485760:12345-0@lo:101:mount.lustre.0 Request processed in 7420us (12252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541177.200220:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788541177.200531:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541177.201196:0:15833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcfc expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.201212:0:15833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bcfc expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541177.206750:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788541177.207117:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541177.207385:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788541177.207460:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788541177.207497:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788541177.207548:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788541177.207586:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788541177.207635:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788541177.207673:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788541177.207708:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788541177.207757:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788541177.207795:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788541177.207846:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788541177.207905:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788541177.207942:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788541177.207990:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788541177.208041:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788541177.208078:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788541177.208112:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788541177.208180:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788541177.208220:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788541177.208255:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788541177.208304:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788541177.208342:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788541177.208378:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788541177.208452:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788541177.208488:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788541177.208523:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788541177.208593:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788541177.208628:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788541177.208660:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788541177.208706:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788541177.208743:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788541177.208778:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788541177.208814:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788541177.208863:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788541177.208901:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788541177.208948:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788541177.209004:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788541177.209085:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788541177.209093:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788541177.209184:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541177.210426:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541177.210477:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968485888 00000100:00100000:0.0:1788541177.210479:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541177.210486:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968485888 00000100:00100000:2.0:1788541177.210547:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788541177.210558:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968485888:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541177.210811:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968485888:12345-0@lo:501:mount.lustre.0 Request processed in 254us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541177.210828:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541177.211935:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968485888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541177.212239:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968486016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541177.212301:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.212324:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.212345:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486016 00000100:00100000:0.0:1788541177.212351:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486016 00000100:00100000:0.0:1788541177.212391:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788541177.212401:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968486016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541177.212620:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968486016:12345-0@lo:503:mount.lustre.0 Request processed in 219us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.212628:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788541177.212756:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968486016:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788541177.213827:0:15833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788541177.213906:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968486144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541177.213962:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.214012:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541177.214035:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486144 00000100:00100000:0.0:1788541177.214040:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486144 00000100:00100000:0.0:1788541177.214075:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788541177.214208:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968486144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541177.214427:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968486144:12345-0@lo:502:mount.lustre.0 Request processed in 323us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.214435:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788541177.214480:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968486144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541177.214791:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788541177.214856:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788541177.214900:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788541177.214946:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788541177.214997:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788541177.215047:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788541177.215218:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788541177.215264:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788541177.215312:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788541177.215347:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788541177.215381:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788541177.215451:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788541177.215490:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788541177.215523:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788541177.215593:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788541177.215707:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788541177.215752:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788541177.215819:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788541177.215856:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788541177.215892:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788541177.215939:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788541177.216931:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788541177.217008:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788541177.217071:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788541177.217123:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788541177.217169:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788541177.217212:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788541177.217241:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788541177.217269:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788541177.217308:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788541177.217337:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788541177.217367:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788541177.217395:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788541177.217475:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788541177.217507:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788541177.217567:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788541177.217600:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788541177.217642:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788541177.217689:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788541177.217725:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788541177.217780:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968486272:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541177.217856:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.217890:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7901e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541177.218522:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486272 00000100:00100000:3.0:1788541177.218530:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486272 00000100:00100000:3.0:1788541177.218582:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788541177.218592:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968486272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541177.218839:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968486272:12345-0@lo:502:mount.lustre.0 Request processed in 248us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541177.218846:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788541177.218984:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968486272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541177.219076:0:15833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788541177.219101:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788541177.224812:0:15843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788541177.224831:0:15843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98d7ae253380) 00000020:00000080:3.0:1788541177.224864:0:15843:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788541177.224931:0:15843:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98d786415800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788541177.224935:0:15843:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98d786415800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788541177.224937:0:15843:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98d786415800 3 00010000:00080000:3.0:1788541177.224965:0:15843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98d7adc63800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.159@tcp at head 00010000:00010000:3.0:1788541177.226569:0:15843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788541177.226756:0:15843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788541177.226791:0:15843:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788541177.226818:0:15843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc9a6a13d3cd1bd0a 00000100:00080000:3.0:1788541177.226828:0:15843:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541177.226833:0:15843:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98d7adc63800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:3.0:1788541177.226870:0:15843:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7b2f33480 x1875420968486400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541177.226901:0:15843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788541177.226954:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875420968486400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541177.227065:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788541177.227168:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541177.227173:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788541177.227175:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541177.227180:0:13994:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:0.0:1788541177.227184:0:13994:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788541177.227188:0:13994:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d7b4003800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:0.0:1788541177.227202:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d7bf4c6d80 x1875420968486656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541177.227259:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968486528:0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.227291:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.227311:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541177.227316:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968486784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.227337:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.227372:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968486912:0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.227395:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.227443:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486528 00000100:00100000:0.0:1788541177.227450:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486528 00000100:00100000:0.0:1788541177.227495:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541177.227506:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968486528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.227557:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968486528:12345-0@lo:400:kworker.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.227564:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541177.227585:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486400 00000100:00100000:0.0:1788541177.227589:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486400 00000100:00100000:0.0:1788541177.227598:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486784 00000100:00100000:0.0:1788541177.227600:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486784 00000100:00100000:0.0:1788541177.227613:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486912 00000100:00100000:0.0:1788541177.227615:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486912 00000100:00100000:0.0:1788541177.227628:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541177.227648:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968486784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.227677:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968486784:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.227683:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541177.227693:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541177.227699:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968486912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.227729:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875420968486912:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.227734:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541177.227745:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541177.227749:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1875420968486400:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788541177.227780:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:0.0:1788541177.227814:0:14431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc9a6a13d3cd1bd11 00000004:00100000:0.0:1788541177.227831:0:14431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788541177.227858:0:14431:0:(import.c:65:import_set_state_nolock()) ffff98d682f55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541177.227891:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875420968486400:12345-0@lo:38:llog_process_th.0 Request processed in 140us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.227897:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788541177.227916:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541177.227920:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541177.227946:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7bf4c4a80 x1875420968486912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541177.227958:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1875420968486912:0@lo:400:kworker.0 00000100:00100000:2.0:1788541177.227997:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968486656:0@lo:8:kworker.0 00010000:00080000:0.0:1788541177.227997:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7bf4c6300 x1875420968486784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541177.228006:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968486784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541177.228016:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788541177.228025:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968486528:0@lo:400:kworker.0 00000100:00100000:2.0:1788541177.228029:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788541177.228070:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98d7b2f33480 x1875420968486400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541177.228077:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788541177.228082:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788541177.228089:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788541177.228093:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788541177.228095:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7adc63800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788541177.228100:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1875420968486400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541177.230186:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968486656 00000100:00100000:1.0:1788541177.230200:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968486656 00000100:00100000:1.0:1788541177.230240:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541177.230248:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1875420968486656:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788541177.230332:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1875420968486656:12345-0@lo:8:kworker.0 Request processed in 83us (2301us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788541177.230348:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541177.230431:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788541177.230439:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541177.230443:0:3313:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788541177.230446:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968486656:0@lo:8:kworker.0 00000040:00080000:3.0:1788541177.231314:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788541177.231726:0:15833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788541177.231751:0:15833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788541177.231775:0:15833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcfc expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.231786:0:15833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cda00/0xc9a6a13d3cd1bcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bcfc expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788541177.231842:0:15833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788541177.231845:0:15833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541177.231846:0:15833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541177.231847:0:15833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541177.231849:0:15833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541177.231850:0:15833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541177.231851:0:15833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541177.231853:0:15833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541177.231855:0:15833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788541177.231859:0:15833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788541177.231861:0:15833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788541177.231862:0:15833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541177.231864:0:15833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541177.231865:0:15833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541177.231866:0:15833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541177.231867:0:15833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541177.231868:0:15833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541177.231870:0:15833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541177.231871:0:15833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788541177.231893:0:15833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788541177.231918:0:15833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968487040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788541177.231991:0:15833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.232032:0:15833:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782c5c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541177.232098:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487040 00000100:00100000:2.0:1788541177.232105:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487040 00000100:00100000:2.0:1788541177.232145:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788541177.232154:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:15833:x1875420968487040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541177.232193:0:14426:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788541177.232206:0:14426:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788541177.240635:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788541177.263173:0:14426:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788541177.263195:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788541177.263302:0:14446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788541177.263307:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788541177.263327:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.263346:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.263354:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.263394:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.263423:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 19 pid: 14425 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541177.263440:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1875420968487168:0@lo:104: 00000100:00100000:1.0:1788541177.263509:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541177.263557:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d782bde9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541177.263739:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487168 00000100:00100000:3.0:1788541177.263748:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487168 00000100:00100000:3.0:1788541177.263798:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541177.263806:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14446:x1875420968487168:12345-0@lo:104: 00010000:00010000:3.0:1788541177.263819:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541177.263879:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788541177.263885:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:14446:x1875420968487168:12345-0@lo:104: Request processed in 80us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541177.263891:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541177.263957:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1875420968487168:0@lo:104: 00010000:00010000:1.0:1788541177.263989:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265500:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541177.265511:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265521:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cca00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541177.265526:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265552:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541177.265559:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541177.265564:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541177.265606:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265612:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541177.265646:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265653:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cca00/0xc9a6a13d3cd1bbe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bbeb expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265670:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541177.265672:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541177.265673:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541177.265682:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541177.265700:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968487296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541177.265756:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541177.265809:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487296 00000100:00100000:0.0:1788541177.265816:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487296 00010000:00010000:0.0:1788541177.265841:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 20 pid: 14425 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541177.265869:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541177.265885:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+20:3316:x1875420968487296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541177.265896:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541177.265902:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 20 pid: 14425 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265913:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 20 pid: 14425 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265926:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7bf4cc400/0xc9a6a13d3cd1bbeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbe4 expref: 20 pid: 14425 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265939:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265948:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788541177.265962:0:14416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002656368s 00010000:00010000:0.0:1788541177.265967:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265983:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265990:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.265996:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.266001:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541177.266010:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.266019:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.266031:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541177.266043:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541177.266077:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3316:x1875420968487296:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541177.266084:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541177.266121:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968487296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541177.266443:0:14446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.266453:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541177.266466:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780030000/0xc9a6a13d3cd1bd18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541177.273054:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:15833:x1875420968487040:12345-0@lo:253:mount.lustre.0 Request processed in 40891us (41052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541177.273070:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788541177.273316:0:15833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e59d638-365e-4b5a-a31c-1933ab9279a7:15833:1875420968487040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541177.273332:0:15833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788541177.273335:0:15833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541177.273337:0:15833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788541177.273338:0:15833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541177.273340:0:15833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541177.273341:0:15833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541177.273343:0:15833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541177.273345:0:15833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541177.273360:0:15833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541177.273362:0:15833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788541177.273379:0:15833:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788541177.278902:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788541177.279109:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788541177.279354:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788541177.279723:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788541177.279879:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788541177.280106:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788541177.280890:0:15833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788541177.330921:0:15833:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788541177.330930:0:15833:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788541177.330959:0:15833:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788541177.331057:0:15833:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788541177.331070:0:15833:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788541177.331100:0:15833:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1788541177.816519:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541177.816555:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968487424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541177.816654:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541177.816786:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487424 00000100:00100000:3.0:1788541177.816795:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487424 00000100:00100000:3.0:1788541177.816847:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541177.816857:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968487424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541177.816890:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541177.816936:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968487424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541177.816943:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541177.817004:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968487424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788541178.267440:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788541178.717812:0:14428:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788541178.717824:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98d682549800 from 8 10000000:01000000:2.0:1788541178.717829:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788541178.717879:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541178.717891:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541178.717903:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541178.717933:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968487552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541178.718023:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541178.718077:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786b34540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541178.718183:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487552 00000100:00100000:1.0:1788541178.718191:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487552 00000100:00100000:1.0:1788541178.718257:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788541178.718268:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968487552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541178.718282:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541178.718534:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d780031400/0xc9a6a13d3cd1bd26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1bd1f expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541178.718560:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d780031400/0xc9a6a13d3cd1bd26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bd1f expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541178.718571:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d780031400/0xc9a6a13d3cd1bd26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bd1f expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541178.718581:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d780031400, rc 0) 00000100:00100000:1.0:1788541178.718637:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968487552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 369us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541178.718644:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788541178.718779:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968487552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541178.718796:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bd26 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541178.718806:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1bd26 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541178.718874:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968487680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788541178.718909:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541178.718942:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786b34540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541178.719046:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487680 00000100:00100000:3.0:1788541178.719052:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487680 00000100:00100000:3.0:1788541178.719106:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788541178.719115:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968487680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788541178.719137:0:14426:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788541178.719154:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788541178.719157:0:14426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788541178.719278:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968487680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 164us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541178.719285:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541178.719538:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968487680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541178.719603:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541178.719613:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bd26 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541178.719622:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf602e00/0xc9a6a13d3cd1bd1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1bd26 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541179.288606:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541179.672784:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788541180.313226:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541181.335685:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.362833:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541182.423893:0:13994:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541182.423900:0:13994:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788541182.423914:0:13994:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541182.423942:0:13994:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98d7b4003800 using connection 192.168.202.159@tcp/0@lo 00000100:00100000:2.0:1788541182.423967:0:13994:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98d682925f80 x1875420968488064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541182.424029:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968488320:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424102:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541182.424156:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788541182.424163:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968487808:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424193:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541182.424216:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968488448:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424236:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541182.424260:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968487936:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424284:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541182.424301:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541182.424305:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968488192:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424324:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541182.424351:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968488064:0@lo:8:kworker.0 00000100:00100000:2.0:1788541182.424373:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541182.424403:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488320 00000100:00100000:2.0:1788541182.424438:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488320 00000100:00100000:2.0:1788541182.424483:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488448 00000100:00100000:2.0:1788541182.424487:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488448 00000100:00100000:2.0:1788541182.424500:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488192 00000100:00100000:2.0:1788541182.424502:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488192 00000100:00100000:2.0:1788541182.424516:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541182.424524:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968488320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424588:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875420968488320:12345-0@lo:400:kworker.0 Request processed in 65us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541182.424595:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541182.424613:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541182.424620:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968488448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424646:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968488448:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541182.424651:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541182.424662:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541182.424669:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968488192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424698:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968488192:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541182.424703:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541182.424721:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487808 00000100:00100000:2.0:1788541182.424724:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487808 00000100:00100000:2.0:1788541182.424746:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788541182.424752:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3314:x1875420968487808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424780:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3314:x1875420968487808:12345-0@lo:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541182.424785:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788541182.424816:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968487936 00000100:00100000:2.0:1788541182.424820:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968487936 00000100:00100000:2.0:1788541182.424842:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488064 00000100:00100000:2.0:1788541182.424845:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488064 00000100:00100000:2.0:1788541182.424858:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541182.424863:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968487936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.424898:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968487936:12345-0@lo:400:kworker.0 Request processed in 35us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541182.424904:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541182.424915:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541182.424919:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1875420968488064:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788541182.424956:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1788541182.424984:0:15114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc9a6a13d3cd1bd2d 00002000:00100000:2.0:1788541182.424996:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98d7bbaff000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788541182.425000:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788541182.425003:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788541182.425330:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788541182.425356:0:15114:0:(import.c:65:import_set_state_nolock()) ffff98d7bbafd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541182.425399:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875420968488064:12345-0@lo:8:kworker.0 Request processed in 478us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541182.425433:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788541182.425462:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541182.425466:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788541182.425750:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682925f80 x1875420968488064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541182.425769:0:3313:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788541182.425777:0:3313:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788541182.425783:0:3313:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788541182.425785:0:3313:0:(import.c:65:import_set_state_nolock()) ffff98d7b4003800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788541182.425795:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788541182.425800:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1875420968488064:0@lo:8:kworker.0 00010000:00080000:2.0:1788541182.425839:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682925c00 x1875420968488192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541182.425859:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968488192:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.425874:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968487936:0@lo:400:kworker.0 00000100:00100000:2.0:1788541182.425910:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968487808:0@lo:400:kworker.0 00010000:00080000:2.0:1788541182.425922:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682924e00 x1875420968488448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541182.425942:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968488448:0@lo:400:kworker.0 00010000:00080000:2.0:1788541182.425954:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d682925180 x1875420968488320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541182.425960:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1875420968488320:0@lo:400:kworker.0 00000004:00080000:0.0:1788541182.428979:0:14455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788541182.429015:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1875420968488704:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788541182.429085:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541182.429117:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7909f73c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788541182.429137:0:14454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788541182.429594:0:14454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 467429184390ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788541182.429611:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541182.429624:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968488576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541182.429657:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541182.429693:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488576 00000100:00100000:0.0:1788541182.429701:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488576 00000100:00100000:0.0:1788541182.429753:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541182.429761:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968488576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541182.429791:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541182.429836:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875420968488576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541182.429844:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788541182.429866:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788541182.429900:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98d7bf4c5c00 x1875420968488576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541182.429941:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968488576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541182.429981:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488704 00000100:00100000:0.0:1788541182.429986:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488704 00000100:00100000:0.0:1788541182.430013:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541182.430020:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14455:x1875420968488704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788541182.450839:0:15114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788541182.450860:0:15114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788541182.450867:0:15114:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788541182.460142:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.460156:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460174:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.460179:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.460185:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460204:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460216:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460223:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460247:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.460262:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.460267:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460275:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.460280:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460300:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460318:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460326:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3efaeb/0xc9a6a13d3cd1bd34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460348:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.460349:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.460351:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.460857:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.460864:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460873:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.460876:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.460880:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460889:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460896:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460909:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460924:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.460948:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.460954:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460960:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.460964:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460972:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460985:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.460993:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01110e9/0xc9a6a13d3cd1bd3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461011:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.461013:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.461015:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.461497:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.461512:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461522:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.461526:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.461530:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461540:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461549:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461556:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461576:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.461587:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.461591:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461599:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.461602:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461610:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461630:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461638:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6e4b7e5/0xc9a6a13d3cd1bd42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.461655:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.461657:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.461660:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.462303:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.462311:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462321:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.462325:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.462330:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462341:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462351:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462358:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462386:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.462399:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.462404:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462437:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780031a00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.462441:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462449:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462463:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462470:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000220665d6/0xc9a6a13d3cd1bd49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.462484:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.462485:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.462487:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.468104:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.468118:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468136:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.468147:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.468155:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468171:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468181:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468189:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468207:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.468221:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.468226:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468234:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d780030000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.468238:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468248:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468263:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468281:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9c91b77/0xc9a6a13d3cd1bd50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468305:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.468307:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.468309:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.468783:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.468790:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468800:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.468804:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.468809:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468819:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468827:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468835:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468850:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.468858:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.468868:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468875:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.468879:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468888:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468900:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468908:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bd57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.468924:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.468926:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.468942:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.469359:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.469365:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469374:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.469378:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.469382:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469402:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469428:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469436:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469452:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541182.469564:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541182.469572:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.469583:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541182.469588:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.469597:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.469614:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.469636:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc3a8ca/0xc9a6a13d3cd1bd5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.469652:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.469654:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.469656:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.469814:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.469820:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469829:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.469832:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.469837:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469846:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469854:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469871:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469885:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.469892:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.469896:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469902:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bce00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.469906:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469914:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469924:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469944:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bd65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.469962:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.469964:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.469967:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.470343:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.470356:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470365:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.470369:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.470373:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470383:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470391:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470399:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470851:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.470867:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.470873:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470881:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.470885:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470893:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470912:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470920:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bd6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.470946:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.470948:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.470949:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.471388:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.471394:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.471403:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.471425:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.471431:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.471443:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.471453:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.471461:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.471487:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788541182.472185:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.472192:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472202:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.472205:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.472210:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472220:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472228:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472235:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472318:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788541182.472861:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.472868:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472878:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.472886:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.472890:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472900:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472909:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.472916:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474688:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788541182.474701:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474714:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541182.474719:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474732:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474757:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474766:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000950baa3b/0xc9a6a13d3cd1bd73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474790:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541182.474793:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474810:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bca00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541182.474814:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474821:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474831:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474838:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000596115f5/0xc9a6a13d3cd1bd7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474848:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541182.474852:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474858:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541182.474862:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474869:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474877:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.474888:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.474890:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.474892:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.478049:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.480858:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788541182.480871:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bd81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.482252:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.487732:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.487745:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.487763:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.487767:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.487773:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.487787:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.487805:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.487814:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.487842:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788541182.488465:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.488473:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.488482:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.488485:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.488490:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.488500:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.488508:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.488516:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.488544:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541182.488782:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541182.488790:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488802:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bcc00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541182.488806:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488817:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488833:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488841:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002d0a4c3/0xc9a6a13d3cd1bd88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488862:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541182.488866:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488879:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc600 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541182.488882:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488890:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488899:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488906:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc1fe8ab/0xc9a6a13d3cd1bd8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.488918:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.488920:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.488923:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.489080:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.489087:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.489096:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.489099:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.489103:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.489112:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.489120:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.489128:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.492450:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788541182.494242:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.494257:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.494275:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.494288:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.494295:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.494310:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.494321:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.494330:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497219:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541182.497235:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497250:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bda00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541182.497255:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497268:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497300:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497310:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d90d523b/0xc9a6a13d3cd1bd96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497341:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541182.497345:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497367:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541182.497370:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497378:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497388:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.497395:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541182.497397:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541182.497399:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.498984:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.502671:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788541182.502686:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdc76ff6/0xc9a6a13d3cd1bd9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541182.503358:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.503367:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503381:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.503385:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.503391:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503404:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503446:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503455:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503478:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788541182.503902:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.503908:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503916:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.503919:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.503923:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503945:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503953:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503959:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.503985:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788541182.503997:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541182.504002:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504011:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.504015:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504024:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504040:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504047:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bda4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504063:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.504067:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504072:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.504076:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504094:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504104:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504111:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bdab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504124:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.504126:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.504127:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.504575:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.504581:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504590:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.504593:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.504597:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504607:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504615:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504631:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504645:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.504654:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.504658:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504663:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bce00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.504667:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504674:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504684:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504690:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c2afef/0xc9a6a13d3cd1bdb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.504703:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.504704:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.504705:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.505130:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.505145:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505153:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.505157:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.505161:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505171:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505179:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505186:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505201:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.505209:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.505213:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505219:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.505222:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505229:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505245:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505252:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1bdb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505265:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.505267:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.505269:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.505695:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.505701:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505710:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.505713:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.505717:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505725:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505734:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505741:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505766:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541182.505775:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541182.505779:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505785:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc800 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:1.0:1788541182.505788:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505795:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505806:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505814:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034184c93/0xc9a6a13d3cd1bdc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.505828:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.505830:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541182.505831:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.505995:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541182.506388:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.513284:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.513300:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.513318:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.513329:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.513336:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.513352:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.513363:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.513370:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.513398:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541182.513610:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541182.513619:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.513629:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bd000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541182.513635:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.513657:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.513676:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.513685:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e25a396d/0xc9a6a13d3cd1bdc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.513706:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.513708:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.513710:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.514690:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.514700:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.514711:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.514714:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.514719:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.514729:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.514737:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.514750:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.514774:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541182.514936:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541182.514943:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.514952:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541182.514957:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.514965:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.514978:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.514998:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de607e4/0xc9a6a13d3cd1bdce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.515016:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.515018:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.515020:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.515615:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.515624:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.515634:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.515638:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.515643:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.515655:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.515664:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.515672:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.515801:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788541182.515815:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788541182.515888:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541182.515895:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.515902:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bde00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541182.515907:0:15589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.515916:0:15589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.515940:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.515955:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f73358/0xc9a6a13d3cd1bdd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541182.515972:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541182.515974:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541182.515975:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.519447:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.519469:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.519486:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.519491:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.519498:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.519512:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.519522:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.519530:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.519551:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541182.519620:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541182.519629:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.519640:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bdc00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541182.519646:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.519657:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.519674:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.519682:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000faf8f1c/0xc9a6a13d3cd1bddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541182.519700:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.519703:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541182.519705:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541182.520337:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.520344:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520354:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.520357:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.520361:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520370:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520385:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520391:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520436:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788541182.520833:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788541182.520839:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520848:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1788541182.520851:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541182.520855:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520865:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520872:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520879:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541182.520916:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788541182.523437:0:15114:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788541182.523557:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14455:x1875420968488704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93533us (94466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541182.523569:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541182.523632:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7bf4c4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1875420968488704:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788541182.523647:0:14455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788541182.523691:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1875420968488832:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788541182.523728:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541182.523768:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7910abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541182.523786:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488832 00000100:00100000:1.0:1788541182.523792:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488832 00000100:00100000:1.0:1788541182.523833:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541182.523843:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14455:x1875420968488832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788541182.523878:0:15115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788541182.524219:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541182.524228:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524241:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc000 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541182.524245:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524255:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524273:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524281:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f43a96e/0xc9a6a13d3cd1bde3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524301:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541182.524304:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524322:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7999bc400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:0.0:1788541182.524326:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524333:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524343:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524349:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7180fc5/0xc9a6a13d3cd1bdea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541182.524361:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.524362:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.524364:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541182.525226:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541182.530712:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14455:x1875420968488832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6862us (6974us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788541182.530725:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541182.530987:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1875420968488832:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788541182.531005:0:14455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788541182.935587:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541182.935611:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968488960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541182.935679:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541182.935747:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968488960 00000100:00100000:3.0:1788541182.935754:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968488960 00000100:00100000:3.0:1788541182.935802:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541182.935812:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968488960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541182.935847:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541182.935891:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968488960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541182.935897:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541182.935975:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968488960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788541183.387899:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541183.992026:0:16186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg259-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788541184.407773:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541185.436220:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541186.457392:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541186.885876:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541186.886318:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424128 00000100:00100000:2.0:1788541186.886342:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424128 00000100:00100000:1.0:1788541186.886762:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:1.0:1788541186.886776:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875420945424128:12345-192.168.202.59@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788541186.887193:0:14424:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 54f362de-fc37-4008-b51a-09fbe19369bd@192.168.202.59@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788541186.887315:0:14424:0:(genops.c:1385:class_connect()) connect: client 54f362de-fc37-4008-b51a-09fbe19369bd, cookie 0xc9a6a13d3cd1bdf1 00000100:00080000:1.0:1788541186.887940:0:14424:0:(import.c:65:import_set_state_nolock()) ffff98d682f43000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541186.889324:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+5:2357:x1875420945424128:12345-192.168.202.59@tcp:250:mount.lustre.0 Request processed in 1459us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541186.889341:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 74 00000100:00100000:2.0:1788541186.906442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541186.911454:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424256 00000100:00100000:3.0:1788541186.911473:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424256 00000100:00100000:3.0:1788541186.911573:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 75 00000100:00100000:3.0:1788541186.911585:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+5:13741:x1875420945424256:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788541186.911601:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541186.911635:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cc800/0xc9a6a13d3cd1bdf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac198d expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541186.911665:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cc800/0xc9a6a13d3cd1bdf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac198d expref: 6 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541186.911676:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cc800/0xc9a6a13d3cd1bdf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac198d expref: 6 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541186.911686:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc800, rc 0) 00000100:00100000:3.0:1788541186.911764:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+6:13741:x1875420945424256:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 182us (5360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541186.911771:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 75 00000100:00100000:2.0:1788541186.921390:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541186.921545:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424384 00000100:00100000:1.0:1788541186.921564:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424384 00000100:00100000:1.0:1788541186.921664:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:1.0:1788541186.921746:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+6:13741:x1875420945424384:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788541186.928208:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+6:13741:x1875420945424384:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 6447us (6807us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541186.932759:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 76 00000100:00100000:0.0:1788541186.940186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541186.940346:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424512 00000100:00100000:3.0:1788541186.940356:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424512 00000100:00100000:3.0:1788541186.940444:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:3.0:1788541186.940457:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+6:13741:x1875420945424512:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788541186.940477:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541186.940498:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf4cc600/0xc9a6a13d3cd1bdff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1994 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541186.940531:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf4cc600/0xc9a6a13d3cd1bdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1994 expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541186.940544:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf4cc600/0xc9a6a13d3cd1bdff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1994 expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541186.940555:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cc600, rc 0) 00000100:00100000:3.0:1788541186.940624:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+7:13741:x1875420945424512:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 169us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541186.940645:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 77 00000100:00100000:2.0:1788541186.944749:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541186.944960:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424640 00000100:00100000:1.0:1788541186.944977:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424640 00000100:00100000:1.0:1788541186.945064:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:1.0:1788541186.945077:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+7:13741:x1875420945424640:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788541186.945637:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+8:13741:x1875420945424640:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 562us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541186.945647:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 78 00000100:00100000:1.0:1788541186.950730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541186.951180:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424768 00000100:00100000:2.0:1788541186.951195:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424768 00000100:00100000:2.0:1788541186.951573:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:2.0:1788541186.951589:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+8:13741:x1875420945424768:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788541186.953919:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+8:13741:x1875420945424768:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 2320us (3251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541186.953938:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 79 00000100:00100000:0.0:1788541186.981190:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541186.985123:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945424896 00000100:00100000:3.0:1788541186.985152:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945424896 00000100:00100000:3.0:1788541186.985224:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:3.0:1788541186.985234:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+8:13760:x1875420945424896:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541186.989403:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+8:13760:x1875420945424896:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 4154us (8415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541186.989438:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 80 00000100:00100000:3.0:1788541187.016945:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541187.017154:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425024 00000100:00100000:0.0:1788541187.017169:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425024 00000100:00100000:0.0:1788541187.017239:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:0.0:1788541187.017272:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+8:13760:x1875420945425024:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541187.017926:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+8:13760:x1875420945425024:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 655us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541187.017936:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 81 00000100:00100000:2.0:1788541187.033153:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541187.034662:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425152 00000100:00100000:1.0:1788541187.034680:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425152 00000100:00100000:1.0:1788541187.034755:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:1.0:1788541187.034784:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+8:13741:x1875420945425152:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541187.034804:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541187.034935:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1be06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac19be expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541187.034973:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1be06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19be expref: 9 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541187.034986:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bde00/0xc9a6a13d3cd1be06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19be expref: 9 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541187.034997:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bde00, rc 0) 00000100:00100000:1.0:1788541187.035085:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+9:13741:x1875420945425152:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 303us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.035093:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 82 00000100:00100000:2.0:1788541187.045716:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541187.046031:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425280 00000100:00100000:1.0:1788541187.046046:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425280 00000100:00100000:1.0:1788541187.046124:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:1.0:1788541187.046138:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+9:13741:x1875420945425280:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788541187.046174:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788541187.046205:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788541187.046210:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788541187.046214:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788541187.046217:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788541187.047695:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+9:13741:x1875420945425280:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 1546us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.047712:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 83 00000100:00100000:3.0:1788541187.050911:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541187.051665:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425408 00000100:00100000:2.0:1788541187.051676:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425408 00000100:00100000:2.0:1788541187.051760:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:2.0:1788541187.051775:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+9:13741:x1875420945425408:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788541187.051794:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541187.051814:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac19c5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541187.051845:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541187.051858:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541187.051897:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:2.0:1788541187.051965:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+10:13741:x1875420945425408:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 194us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541187.051971:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 84 00000100:00100000:2.0:1788541187.059399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541187.060156:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425536 00000100:00100000:1.0:1788541187.060178:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425536 00000100:00100000:1.0:1788541187.060240:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:1.0:1788541187.060251:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+10:13741:x1875420945425536:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788541187.060779:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+10:13741:x1875420945425536:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 527us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.060789:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 85 00000100:00100000:0.0:1788541187.063828:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541187.064091:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425664 00000100:00100000:1.0:1788541187.064101:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425664 00000100:00100000:1.0:1788541187.064163:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:1.0:1788541187.064174:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+10:13741:x1875420945425664:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788541187.064532:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+10:13741:x1875420945425664:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 358us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.064540:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 86 00000100:00100000:3.0:1788541187.067213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541187.069919:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425792 00000100:00100000:2.0:1788541187.069938:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425792 00000100:00100000:2.0:1788541187.070396:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:2.0:1788541187.070438:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+10:13765:x1875420945425792:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541187.070787:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+10:13765:x1875420945425792:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 379us (3580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541187.070796:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 87 00000100:00100000:0.0:1788541187.075754:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541187.080388:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945425920 00000100:00100000:1.0:1788541187.080402:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945425920 00000100:00100000:1.0:1788541187.080461:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:1.0:1788541187.080469:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d79154a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+10:13765:x1875420945425920:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541187.082157:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d79154a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+10:13765:x1875420945425920:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 1680us (6424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.082169:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 88 00000100:00100000:0.0:1788541187.093660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541187.093860:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426048 00000100:00100000:2.0:1788541187.093871:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426048 00000100:00100000:2.0:1788541187.093928:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:2.0:1788541187.093937:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875420945426048:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788541187.093966:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0672894e-cb1f-4a3b-ac8b-b30216598b4a@192.168.202.59@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1788541187.094013:0:14431:0:(genops.c:1385:class_connect()) connect: client 0672894e-cb1f-4a3b-ac8b-b30216598b4a, cookie 0xc9a6a13d3cd1be14 00000004:00100000:2.0:1788541187.094044:0:14431:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788541187.094060:0:14431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788541187.143944:0:14431:0:(import.c:65:import_set_state_nolock()) ffff98d682f51000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541187.144025:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2357:x1875420945426048:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 50086us (50374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541187.144036:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1788541187.146719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541187.146795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541187.146960:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426176 00000100:00100000:2.0:1788541187.146969:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426176 00000100:00100000:2.0:1788541187.147033:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426304 00000100:00100000:2.0:1788541187.147036:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426304 00000100:00100000:2.0:1788541187.147062:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1788541187.147084:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:0:x1875420945426176:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541187.147126:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788541187.147211:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:0:x1875420945426176:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 128us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541187.147219:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00080000:0.0:1788541187.147753:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541187.147847:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1788541187.147860:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13741:x1875420945426304:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788541187.147874:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788541187.147917:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13741:x1875420945426304:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 60us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.147936:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:1.0:1788541187.150035:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541187.150187:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426432 00000100:00100000:0.0:1788541187.150196:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426432 00000100:00100000:0.0:1788541187.150498:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1788541187.150510:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13741:x1875420945426432:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788541187.150762:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13741:x1875420945426432:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 253us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.150769:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1788541187.153108:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541187.153149:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541187.153189:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541187.153216:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426560 00000100:00100000:0.0:1788541187.153224:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426560 00000100:00100000:3.0:1788541187.153403:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426816 00000100:00100000:3.0:1788541187.153434:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426816 00000100:00100000:3.0:1788541187.153487:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1788541187.153497:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13741:x1875420945426816:12345-192.168.202.59@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788541187.154111:0:14433:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 543us 00000100:00100000:0.0:1788541187.154520:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426688 00000100:00100000:0.0:1788541187.154526:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426688 00000100:00100000:0.0:1788541187.154550:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1788541187.154557:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875420945426560:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788541187.154591:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0672894e-cb1f-4a3b-ac8b-b30216598b4a@192.168.202.59@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:0.0:1788541187.154621:0:15114:0:(genops.c:1385:class_connect()) connect: client 0672894e-cb1f-4a3b-ac8b-b30216598b4a, cookie 0xc9a6a13d3cd1be1b 00002000:00100000:0.0:1788541187.154632:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0672894e-cb1f-4a3b-ac8b-b30216598b4a/ffff98d682f52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788541187.154657:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788541187.154986:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788541187.155017:0:15114:0:(import.c:65:import_set_state_nolock()) ffff98d682f54800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541187.155179:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1788541187.155186:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875420945426688:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788541187.155205:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0672894e-cb1f-4a3b-ac8b-b30216598b4a@192.168.202.59@tcp t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788541187.155225:0:15116:0:(genops.c:1385:class_connect()) connect: client 0672894e-cb1f-4a3b-ac8b-b30216598b4a, cookie 0xc9a6a13d3cd1be22 00002000:00100000:3.0:1788541187.155509:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0672894e-cb1f-4a3b-ac8b-b30216598b4a/ffff98d682cf1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788541187.155529:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788541187.155664:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788541187.155683:0:15116:0:(import.c:65:import_set_state_nolock()) ffff98d682cf6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541187.155735:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2357:x1875420945426688:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 547us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541187.155756:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:0.0:1788541187.156478:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2357:x1875420945426560:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 1917us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541187.156488:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000004:00200000:2.0:1788541187.168759:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788541187.168880:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13741:x1875420945426816:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 15379us (15775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541187.168907:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:0.0:1788541187.457064:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541187.457234:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945426944 00000100:00100000:3.0:1788541187.457245:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945426944 00000100:00100000:3.0:1788541187.457311:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:3.0:1788541187.457323:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:13786:x1875420945426944:12345-192.168.202.59@tcp:101:mkdir.0 00010000:00010000:3.0:1788541187.457345:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541187.457369:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1be29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac19ef expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541187.457486:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1be30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541187.457501:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1be30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541187.457516:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1be30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541187.457562:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541187.457566:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541187.457601:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1be30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541187.457624:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1be29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19ef expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541187.457646:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1be30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19ef expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541187.457673:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:3.0:1788541187.457676:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541187.457680:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cca00, rc 0) 00000100:00100000:3.0:1788541187.458148:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:13786:x1875420945426944:12345-192.168.202.59@tcp:101:mkdir.0 Request processed in 825us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541187.458156:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00010000:00010000:3.0:1788541187.480206:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541187.545498:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968489088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541187.545571:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541187.545656:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489088 00000100:00100000:0.0:1788541187.545665:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489088 00000100:00100000:0.0:1788541187.545729:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788541187.545738:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968489088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541187.545760:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541187.545765:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968489344:0@lo:400:kworker.0 00000100:00100000:1.0:1788541187.545795:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541187.545816:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541187.545818:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968489088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.545821:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968489472:0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.545832:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541187.545842:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541187.545864:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489344 00000100:00100000:0.0:1788541187.545867:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e59d638-365e-4b5a-a31c-1933ab9279a7:3315:1875420968489216:0@lo:400:kworker.0 00000100:00100000:1.0:1788541187.545868:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489344 00000100:00100000:0.0:1788541187.545906:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541187.545908:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541187.545915:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968489344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.545926:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968489728:0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.545943:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541187.545947:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968489344:12345-0@lo:400:kworker.0 Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.545953:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541187.545959:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541187.545963:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968489600:0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.545984:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541187.545985:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968489344:0@lo:400:kworker.0 00000100:00100000:1.0:1788541187.546006:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489216 00000100:00100000:1.0:1788541187.546009:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489216 00000100:00100000:1.0:1788541187.546031:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788541187.546036:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968489088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541187.546038:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d791549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3315:x1875420968489216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.546054:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489472 00000100:00100000:0.0:1788541187.546057:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489472 00000100:00100000:1.0:1788541187.546069:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d791549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3315:x1875420968489216:12345-0@lo:400:kworker.0 Request processed in 32us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541187.546073:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489728 00000100:00100000:1.0:1788541187.546075:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788541187.546076:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489728 00000100:00100000:0.0:1788541187.546087:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489600 00000100:00100000:0.0:1788541187.546089:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489600 00000100:00100000:0.0:1788541187.546103:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541187.546108:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968489472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541187.546111:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e59d638-365e-4b5a-a31c-1933ab9279a7:3315:1875420968489216:0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.546146:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875420968489472:12345-0@lo:400:kworker.0 Request processed in 38us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.546151:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875420968489472:0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.546153:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541187.546169:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788541187.546176:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968489728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541187.546177:0:14431:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788541187.546184:0:14431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788541187.546206:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875420968489728:12345-0@lo:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.546212:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541187.546213:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1875420968489728:0@lo:400:kworker.0 00000100:00100000:1.0:1788541187.546223:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788541187.546229:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968489600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541187.546264:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875420968489600:12345-0@lo:400:kworker.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541187.546269:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541187.546548:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1875420968489600:0@lo:400:kworker.0 00000100:00080000:2.0:1788541187.546671:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541187.546676:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541187.546678:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788541187.749034:0:7660:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788541187.749126:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788541187.749133:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0672894e-cb1f-4a3b-ac8b-b30216598b4a 00000100:00100000:1.0:1788541188.057599:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d682924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968489856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541188.057680:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541188.057768:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489856 00000100:00100000:2.0:1788541188.057776:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489856 00000100:00100000:2.0:1788541188.057841:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541188.057851:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968489856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541188.057875:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541188.057935:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968489856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541188.057941:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541188.057985:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d682924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968489856:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788541188.168718:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0672894e-cb1f-4a3b-ac8b-b30216598b4a 00010000:00010000:1.0:1788541188.505697:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541189.417780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.417951:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427072 00000100:00100000:1.0:1788541189.417961:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427072 00000100:00100000:1.0:1788541189.418048:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1788541189.418060:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:13839:x1875420945427072:12345-192.168.202.59@tcp:41:lfs.0 00000004:00000024:1.0:1788541189.418102:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788541189.418191:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:13839:x1875420945427072:12345-192.168.202.59@tcp:41:lfs.0 Request processed in 134us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.418199:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00080000:2.0:1788541189.418657:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541189.423509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541189.423615:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427200 00000100:00100000:2.0:1788541189.423626:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427200 00000100:00100000:2.0:1788541189.423705:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1788541189.423715:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:13839:x1875420945427200:12345-192.168.202.59@tcp:13:lfs.0 00002000:00000024:2.0:1788541189.423753:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541189.423847:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:13839:x1875420945427200:12345-192.168.202.59@tcp:13:lfs.0 Request processed in 125us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541189.423855:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00080000:0.0:1788541189.424131:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541189.433812:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541189.434049:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427328 00000100:00100000:2.0:1788541189.434060:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427328 00000100:00100000:2.0:1788541189.434129:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1788541189.434139:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:13839:x1875420945427328:12345-192.168.202.59@tcp:13:lfs.0 00002000:00000024:2.0:1788541189.434176:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788541189.434385:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541189.434481:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:13839:x1875420945427328:12345-192.168.202.59@tcp:13:lfs.0 Request processed in 342us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541189.434489:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00010000:00010000:0.0:1788541189.528663:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541189.685065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.685320:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427456 00000100:00100000:1.0:1788541189.685341:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427456 00000100:00100000:1.0:1788541189.685399:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:1.0:1788541189.685433:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+10:13874:x1875420945427456:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541189.685448:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541189.685465:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bc600/0xc9a6a13d3cd1be37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac19f6 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.685492:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bc600/0xc9a6a13d3cd1be37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19f6 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.685503:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bc600/0xc9a6a13d3cd1be37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19f6 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.685513:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bc600, rc 0) 00000100:00100000:1.0:1788541189.685688:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+11:13874:x1875420945427456:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 280us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.685696:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 90 00000100:00100000:0.0:1788541189.687176:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541189.687264:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427584 00000100:00100000:2.0:1788541189.687272:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427584 00000100:00100000:2.0:1788541189.687321:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:2.0:1788541189.687330:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+11:13874:x1875420945427584:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788541189.687668:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+11:13874:x1875420945427584:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 339us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541189.687676:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 91 00000100:00100000:0.0:1788541189.689558:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.689751:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427712 00000100:00100000:1.0:1788541189.689760:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427712 00000100:00100000:1.0:1788541189.689816:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:1.0:1788541189.689827:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+11:13874:x1875420945427712:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788541189.690081:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+11:13874:x1875420945427712:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 255us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.690090:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 92 00000100:00100000:0.0:1788541189.698920:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.699256:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427840 00000100:00100000:1.0:1788541189.699267:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427840 00000100:00100000:1.0:1788541189.699338:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:1.0:1788541189.699350:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+11:13878:x1875420945427840:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541189.699672:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+11:13878:x1875420945427840:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 323us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.699680:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 93 00000100:00100000:0.0:1788541189.715536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541189.717003:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945427968 00000100:00100000:2.0:1788541189.717014:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945427968 00000100:00100000:2.0:1788541189.717071:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:2.0:1788541189.717080:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+11:13878:x1875420945427968:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541189.717342:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+11:13878:x1875420945427968:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 262us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541189.717350:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 94 00000100:00100000:0.0:1788541189.726986:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.727434:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428096 00000100:00100000:1.0:1788541189.727444:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428096 00000100:00100000:1.0:1788541189.727538:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:1.0:1788541189.727548:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+11:13874:x1875420945428096:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541189.727564:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541189.727582:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1be3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a20 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.727610:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1be3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a20 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.727622:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bcc00/0xc9a6a13d3cd1be3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a20 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.727631:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bcc00, rc 0) 00000100:00100000:1.0:1788541189.727686:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+12:13874:x1875420945428096:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 140us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.727693:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 95 00000100:00100000:0.0:1788541189.730017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.732061:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428224 00000100:00100000:1.0:1788541189.732074:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428224 00000100:00100000:1.0:1788541189.732126:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:1.0:1788541189.732135:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+12:13874:x1875420945428224:12345-192.168.202.59@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788541189.732159:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788541189.732186:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788541189.732190:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788541189.732193:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788541189.732195:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788541189.738524:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+12:13874:x1875420945428224:12345-192.168.202.59@tcp:256:mount.lustre.0 Request processed in 6378us (8503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.738539:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 96 00000100:00100000:1.0:1788541189.741677:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541189.741773:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428352 00000100:00100000:0.0:1788541189.741783:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428352 00000100:00100000:0.0:1788541189.741903:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:0.0:1788541189.741913:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+12:13874:x1875420945428352:12345-192.168.202.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541189.741928:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541189.741945:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a27 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541189.741972:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541189.741983:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541189.741992:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161c00, rc 0) 00000100:00100000:0.0:1788541189.742052:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+13:13874:x1875420945428352:12345-192.168.202.59@tcp:101:mount.lustre.0 Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541189.742059:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 97 00000100:00100000:3.0:1788541189.744819:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541189.745798:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428480 00000100:00100000:2.0:1788541189.745809:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428480 00000100:00100000:3.0:1788541189.745917:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:3.0:1788541189.745927:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13874:x1875420945428480:12345-192.168.202.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788541189.746200:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13874:x1875420945428480:12345-192.168.202.59@tcp:501:mount.lustre.0 Request processed in 274us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541189.746208:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 98 00000100:00100000:2.0:1788541189.747806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541189.747883:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428608 00000100:00100000:3.0:1788541189.747890:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428608 00000100:00100000:3.0:1788541189.747917:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:3.0:1788541189.747925:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13874:x1875420945428608:12345-192.168.202.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788541189.748114:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13874:x1875420945428608:12345-192.168.202.59@tcp:503:mount.lustre.0 Request processed in 188us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541189.748122:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 99 00000100:00100000:2.0:1788541189.750217:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541189.750655:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428736 00000100:00100000:0.0:1788541189.750662:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428736 00000100:00100000:3.0:1788541189.750759:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:3.0:1788541189.750769:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13882:x1875420945428736:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541189.751038:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13882:x1875420945428736:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 270us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541189.751045:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 100 00000100:00100000:3.0:1788541189.762201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541189.762912:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428864 00000100:00100000:1.0:1788541189.762922:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428864 00000100:00100000:1.0:1788541189.762980:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:1.0:1788541189.762989:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+13:13882:x1875420945428864:12345-192.168.202.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541189.763235:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+13:13882:x1875420945428864:12345-192.168.202.59@tcp:502:llog_process_th.0 Request processed in 246us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.763243:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 101 00000100:00100000:3.0:1788541189.767172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541189.767321:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945428992 00000100:00100000:0.0:1788541189.767333:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945428992 00000100:00100000:0.0:1788541189.767379:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:0.0:1788541189.767389:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875420945428992:12345-192.168.202.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788541189.767460:0:14431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f5d45147-30f1-4e88-b8e5-74d4c60304c2@192.168.202.59@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788541189.767510:0:14431:0:(genops.c:1385:class_connect()) connect: client f5d45147-30f1-4e88-b8e5-74d4c60304c2, cookie 0xc9a6a13d3cd1be4c 00000004:00100000:0.0:1788541189.767548:0:14431:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788541189.767672:0:14431:0:(import.c:65:import_set_state_nolock()) ffff98d682f55800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541189.767745:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2357:x1875420945428992:12345-192.168.202.59@tcp:38:mount.lustre.0 Request processed in 356us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541189.767752:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:2.0:1788541189.781974:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541189.782023:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541189.782118:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429120 00000100:00100000:1.0:1788541189.782123:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429248 00000100:00100000:3.0:1788541189.782128:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429120 00000100:00100000:1.0:1788541189.782129:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429248 00000100:00100000:1.0:1788541189.782208:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1788541189.782220:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+7:13874:x1875420945429248:12345-192.168.202.59@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788541189.782227:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788541189.782251:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788541189.782322:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+7:13874:x1875420945429248:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 105us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.782330:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:1.0:1788541189.782345:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1788541189.782351:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:0:x1875420945429120:12345-192.168.202.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788541189.782361:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788541189.782399:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:0:x1875420945429120:12345-192.168.202.59@tcp:41:mount.lustre.0 Request processed in 48us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541189.782405:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788541189.786591:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541189.786618:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429376 00000100:00100000:3.0:1788541189.786626:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429376 00000100:00100000:3.0:1788541189.786659:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:3.0:1788541189.786668:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:13874:x1875420945429376:12345-192.168.202.59@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788541189.786749:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:13874:x1875420945429376:12345-192.168.202.59@tcp:40:mount.lustre.0 Request processed in 81us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541189.786756:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788541189.791936:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541189.791976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541189.792014:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541189.792131:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429504 00000100:00100000:3.0:1788541189.792143:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429504 00000100:00100000:3.0:1788541189.792181:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429632 00000100:00100000:3.0:1788541189.792184:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429632 00000100:00100000:3.0:1788541189.792200:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1788541189.792208:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875420945429504:12345-192.168.202.59@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788541189.792250:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429760 00010000:00080000:3.0:1788541189.792251:0:15115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f5d45147-30f1-4e88-b8e5-74d4c60304c2@192.168.202.59@tcp t0 exp 0000000000000000 cur 474 last 0 00000100:00100000:2.0:1788541189.792257:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429760 00000020:00000080:3.0:1788541189.792289:0:15115:0:(genops.c:1385:class_connect()) connect: client f5d45147-30f1-4e88-b8e5-74d4c60304c2, cookie 0xc9a6a13d3cd1be53 00000100:00100000:2.0:1788541189.792299:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00002000:00100000:3.0:1788541189.792302:0:15115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f5d45147-30f1-4e88-b8e5-74d4c60304c2/ffff98d682cf4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788541189.792309:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:13874:x1875420945429760:12345-192.168.202.59@tcp:33:mount.lustre.0 00002000:00100000:3.0:1788541189.792315:0:15115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:2.0:1788541189.792383:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788541189.792500:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:13874:x1875420945429760:12345-192.168.202.59@tcp:33:mount.lustre.0 Request processed in 193us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541189.792508:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:0.0:1788541189.792610:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1788541189.792616:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875420945429632:12345-192.168.202.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788541189.792632:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f5d45147-30f1-4e88-b8e5-74d4c60304c2@192.168.202.59@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788541189.792649:0:15116:0:(genops.c:1385:class_connect()) connect: client f5d45147-30f1-4e88-b8e5-74d4c60304c2, cookie 0xc9a6a13d3cd1be5a 00002000:00100000:0.0:1788541189.792654:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f5d45147-30f1-4e88-b8e5-74d4c60304c2/ffff98d682f57000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788541189.792661:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788541189.792815:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788541189.792840:0:15116:0:(import.c:65:import_set_state_nolock()) ffff98d682f57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541189.792896:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2357:x1875420945429632:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 278us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541189.792904:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00002000:00080000:2.0:1788541189.793264:0:15115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788541189.793284:0:15115:0:(import.c:65:import_set_state_nolock()) ffff98d7bef65800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541189.793314:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2357:x1875420945429504:12345-192.168.202.59@tcp:8:mount.lustre.0 Request processed in 1106us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541189.793321:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000040:00080000:0.0:1788541189.912891:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788541189.959297:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541189.959394:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945429888 00000100:00100000:3.0:1788541189.959403:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945429888 00000100:00100000:3.0:1788541189.959690:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1788541189.959700:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:13903:x1875420945429888:12345-192.168.202.59@tcp:101:mkdir.0 00010000:00010000:3.0:1788541189.959719:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541189.959738:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1be61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a51 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.959798:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.959813:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.959824:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541189.959868:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541189.959873:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541189.959891:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.959915:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1be61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.959937:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.959945:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:3.0:1788541189.959948:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541189.959964:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179e00, rc 0) 00000100:00100000:3.0:1788541189.960917:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+7:13903:x1875420945429888:12345-192.168.202.59@tcp:101:mkdir.0 Request processed in 1213us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541189.960926:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00010000:00010000:3.0:1788541190.553816:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541191.598652:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788541192.303294:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f5d45147-30f1-4e88-b8e5-74d4c60304c2 00000001:00100000:3.0:1788541192.303309:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0672894e-cb1f-4a3b-ac8b-b30216598b4a 00010000:00010000:2.0:1788541192.600683:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541192.666071:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968489984:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666165:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541192.666214:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968490496:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666241:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541192.666267:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541192.666273:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666294:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541192.666324:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968490112:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666351:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541192.666371:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968490624:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666394:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541192.666436:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541192.666442:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968490240:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666466:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541192.666499:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968489984 00000100:00100000:3.0:1788541192.666506:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968489984 00000100:00100000:3.0:1788541192.666549:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788541192.666557:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968489984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666602:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968489984:12345-0@lo:400:kworker.0 Request processed in 46us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541192.666622:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788541192.666657:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490496 00000100:00100000:3.0:1788541192.666660:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490496 00000100:00100000:3.0:1788541192.666691:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490368 00000100:00100000:3.0:1788541192.666694:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490368 00000100:00100000:3.0:1788541192.666705:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490624 00000100:00100000:3.0:1788541192.666707:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490624 00000100:00100000:3.0:1788541192.666721:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541192.666726:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968490496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666771:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968490496:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541192.666779:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541192.666792:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788541192.666797:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968490368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666824:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968490368:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541192.666830:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788541192.666852:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788541192.666859:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968490624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.666890:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968490624:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541192.666896:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788541192.666915:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490112 00000100:00100000:3.0:1788541192.666918:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490112 00000100:00100000:3.0:1788541192.666943:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490240 00000100:00100000:3.0:1788541192.666946:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490240 00000100:00100000:3.0:1788541192.666966:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541192.666980:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968490112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667010:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968490112:12345-0@lo:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541192.667016:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541192.667027:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541192.667032:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968490240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667058:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968490240:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541192.667063:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788541192.667089:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541192.667094:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541192.667097:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541192.667130:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788541192.667152:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968490240:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667165:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968490112:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667175:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968490624:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667209:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968490368:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667219:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968489984:0@lo:400:kworker.0 00000100:00100000:3.0:1788541192.667228:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968490496:0@lo:400:kworker.0 00000100:00100000:1.0:1788541192.684513:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968490752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541192.684585:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541192.684649:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490752 00000100:00100000:1.0:1788541192.684657:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490752 00000100:00100000:1.0:1788541192.684703:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788541192.684711:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968490752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541192.684744:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541192.684787:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968490752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541192.684793:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788541192.684929:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968490752:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788541192.878484:0:7660:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f5d45147-30f1-4e88-b8e5-74d4c60304c2 00000100:00100000:0.0:1788541193.181983:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541193.182017:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968490880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541193.182095:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541193.202661:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968490880 00000100:00100000:3.0:1788541193.202678:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968490880 00000100:00100000:3.0:1788541193.202736:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788541193.202746:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968490880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541193.202795:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541193.202902:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875420968490880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (20805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541193.202910:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788541193.202969:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968490880:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788541193.293206:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f5d45147-30f1-4e88-b8e5-74d4c60304c2 00000001:02000400:2.0:1788541193.303884:0:16393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788541193.623508:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541194.653027:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541194.883458:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883509:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883544:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883576:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883593:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883607:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883628:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541194.883654:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430272 00000100:00100000:2.0:1788541194.883663:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430272 00000100:00100000:2.0:1788541194.883709:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430784 00000100:00100000:2.0:1788541194.883711:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430784 00000100:00100000:2.0:1788541194.883723:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430400 00000100:00100000:2.0:1788541194.883725:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430400 00000100:00100000:2.0:1788541194.883734:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430656 00000100:00100000:2.0:1788541194.883736:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430656 00000100:00100000:2.0:1788541194.883749:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1788541194.883758:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2359:x1875420945430272:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541194.883850:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2359:x1875420945430272:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541194.883858:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:2.0:1788541194.883876:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1788541194.883882:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2359:x1875420945430784:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541194.883902:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2359:x1875420945430784:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 21us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541194.883908:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:2.0:1788541194.883917:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1788541194.883922:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2359:x1875420945430400:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541194.883937:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2359:x1875420945430400:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 15us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541194.883948:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1788541194.883958:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788541194.883963:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2359:x1875420945430656:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541194.883994:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2359:x1875420945430656:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541194.883999:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788541194.884015:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430528 00000100:00100000:2.0:1788541194.884017:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430528 00000100:00100000:2.0:1788541194.884039:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430144 00000100:00100000:2.0:1788541194.884041:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430144 00000100:00100000:2.0:1788541194.884058:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541194.884064:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2359:x1875420945430528:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541194.884086:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2359:x1875420945430528:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 23us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541194.884092:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541194.884101:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1788541194.884106:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d682927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2359:x1875420945430144:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541194.884121:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d682927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2359:x1875420945430144:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 15us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541194.884127:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00080000:2.0:1788541194.884145:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541194.884149:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541194.884151:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541194.884591:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430016 00000100:00100000:0.0:1788541194.884596:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430016 00000100:00100000:0.0:1788541194.884630:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 103 00000100:00100000:0.0:1788541194.884637:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+13:2359:x1875420945430016:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541194.884672:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+13:2359:x1875420945430016:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 36us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541194.884678:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 103 00010000:00010000:0.0:1788541195.671578:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541196.696886:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541197.720164:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541197.785183:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968491008:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.785272:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.785318:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968491520:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.785345:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.785519:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541197.785526:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968491392:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.785559:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.785588:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968491136:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.785728:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.785749:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968491648:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.785772:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.785800:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541197.785806:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968491264:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.785829:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.785862:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491008 00000100:00100000:2.0:1788541197.785869:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491008 00000100:00100000:2.0:1788541197.785913:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788541197.785923:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968491008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.786027:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968491008:12345-0@lo:400:kworker.0 Request processed in 105us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.786035:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788541197.786079:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491520 00000100:00100000:2.0:1788541197.786083:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491520 00000100:00100000:2.0:1788541197.786114:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491392 00000100:00100000:2.0:1788541197.786117:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491392 00000100:00100000:2.0:1788541197.786127:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491648 00000100:00100000:2.0:1788541197.786129:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491648 00000100:00100000:2.0:1788541197.786142:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541197.786154:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968491520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.786185:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968491520:12345-0@lo:400:kworker.0 Request processed in 31us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.786191:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541197.786204:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541197.786210:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968491392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.786236:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875420968491392:12345-0@lo:400:kworker.0 Request processed in 27us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.786242:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541197.786255:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541197.787531:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968491648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.787602:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875420968491648:12345-0@lo:400:kworker.0 Request processed in 83us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.788125:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541197.788176:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491136 00000100:00100000:2.0:1788541197.788184:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491136 00000100:00100000:2.0:1788541197.788223:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491264 00000100:00100000:2.0:1788541197.788226:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491264 00000100:00100000:2.0:1788541197.788251:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541197.788761:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968491136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.788851:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968491136:12345-0@lo:400:kworker.0 Request processed in 593us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.788858:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541197.788874:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541197.788881:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968491264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.788911:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968491264:12345-0@lo:400:kworker.0 Request processed in 31us (3081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.788926:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541197.788984:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875420968491392:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.788996:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968491008:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.789005:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968491520:0@lo:400:kworker.0 00000100:00080000:2.0:1788541197.789031:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541197.789035:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541197.789038:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541197.789557:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968491264:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.789571:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968491136:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.789585:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1875420968491648:0@lo:400:kworker.0 00000100:00100000:2.0:1788541197.789618:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541197.789630:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968491776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541197.789668:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541197.790185:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968491776 00000100:00100000:3.0:1788541197.790192:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968491776 00000100:00100000:3.0:1788541197.790253:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541197.790263:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968491776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541197.790293:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788541197.790346:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968491776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541197.790354:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541197.790393:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968491776:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788541197.841108:0:16541:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecff192e0 20000000:00000080:2.0:1788541197.841128:0:16541:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98d682dafc00 uarg=0000000000000000 20000000:01000000:2.0:1788541197.841164:0:16541:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788541197.841169:0:16541:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788541197.841173:0:16541:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788541197.846163:0:16543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788541197.846320:0:16541:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788541197.855329:0:16541:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788541197.855461:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855481:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855489:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855494:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855522:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855530:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855537:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855583:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855599:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 12 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541197.855614:0:16541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968491904:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541197.855859:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855869:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541197.855878:0:16541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492032:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541197.855946:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.855954:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541197.855975:0:16541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf54000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492160:0@lo:104: 00000100:00100000:3.0:1788541197.856015:0:16541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541197.856041:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.856048:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541197.856056:0:16541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492288:0@lo:104: 00000100:00100000:3.0:1788541197.856075:0:16541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541197.856103:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492160 00000100:00100000:3.0:1788541197.856109:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492160 00000100:00100000:3.0:1788541197.856145:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492288 00000100:00100000:3.0:1788541197.856148:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492288 00000100:00100000:3.0:1788541197.856160:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541197.856168:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+4:16541:x1875420968492160:12345-0@lo:104: 00010000:00010000:3.0:1788541197.856181:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.856229:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788541197.856234:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+4:16541:x1875420968492160:12345-0@lo:104: Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541197.856240:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541197.856256:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541197.856261:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:16541:x1875420968492288:12345-0@lo:104: 00010000:00010000:3.0:1788541197.856269:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.856313:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788541197.856319:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:16541:x1875420968492288:12345-0@lo:104: Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541197.856325:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788541197.856343:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541197.856348:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.856355:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160200 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541197.856359:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.856367:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541197.856373:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541197.856379:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541197.860853:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541197.860867:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.860881:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:0.0:1788541197.860886:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.860897:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541197.860903:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541197.860909:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541197.860961:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.860968:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541197.861003:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.861026:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7bf603c00/0xc9a6a13d3cd1bbac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bbb3 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.861042:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541197.861044:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541197.861046:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541197.861092:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.861105:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541197.861119:0:16541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492672:0@lo:104: 00000100:00100000:0.0:1788541197.861185:0:16541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541197.861220:0:16541:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ad2b8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788541197.861245:0:16541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf54000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492160:0@lo:104: 00000100:00100000:0.0:1788541197.861255:0:16541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492288:0@lo:104: 00000100:00100000:1.0:1788541197.861360:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968492544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541197.861393:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541197.865098:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492544 00000100:00100000:0.0:1788541197.865116:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492544 00010000:00010000:0.0:1788541197.865166:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 19 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541197.865210:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788541197.865220:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3316:x1875420968492544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541197.865245:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541197.865252:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 19 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.865280:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 19 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.865298:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d780031200/0xc9a6a13d3cd1bbb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bbac expref: 19 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.865317:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541197.865394:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:3316:x1875420968492544:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541197.865401:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788541197.866221:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968492544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541197.871156:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.871173:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541197.871213:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.871221:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7ae160200/0xc9a6a13d3cd1bce7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bcee expref: -99 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541197.871293:0:14415:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788541197.871313:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492672 00000100:00100000:3.0:1788541197.871322:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492672 00000100:00100000:0.0:1788541197.871717:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541197.871738:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968492416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541197.871809:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541197.871926:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492416 00000100:00100000:2.0:1788541197.871931:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492416 00010000:00010000:2.0:1788541197.871973:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541197.872023:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541197.872032:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:3316:x1875420968492416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541197.872047:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541197.872054:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.872064:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.872082:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7bf4cd000/0xc9a6a13d3cd1bcee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bce7 expref: 18 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.872097:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541197.872137:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:3316:x1875420968492416:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.872144:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541197.872182:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e59d638-365e-4b5a-a31c-1933ab9279a7:3316:1875420968492416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541197.873014:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541197.873026:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bb5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:16541:x1875420968492672:12345-0@lo:104: 00010000:00010000:3.0:1788541197.873041:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.873112:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788541197.873119:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bb5ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+3:16541:x1875420968492672:12345-0@lo:104: Request processed in 96us (11933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541197.873125:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788541197.873210:0:15589:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541197.873216:0:15589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.873224:0:15589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd800 already unused, calling callback (ffffffffc1bc0c20) 10000000:00010000:3.0:1788541197.873229:0:15589:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.873348:0:15589:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541197.873357:0:15589:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541197.873363:0:15589:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541197.873482:0:15589:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.873499:0:15589:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541197.873520:0:15589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.873527:0:15589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.159@tcp lock: ffff98d7bf4cd800/0xc9a6a13d3cd1bb5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc9a6a13d3cd1bb66 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541197.873544:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541197.873545:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541197.873547:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541197.873561:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adf56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968492800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541197.873602:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541197.874080:0:16541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492672:0@lo:104: 00010000:00010000:3.0:1788541197.874093:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541197.874095:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541197.874097:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541197.874684:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541197.874709:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492800 00000100:00100000:2.0:1788541197.874715:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492800 00010000:00010000:2.0:1788541197.874745:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 17 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541197.874772:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945430912 00000100:00100000:2.0:1788541197.874775:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945430912 00010000:00010000:2.0:1788541197.874801:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 13 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541197.874831:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788541197.874839:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf6cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:3314:x1875420968492800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541197.874852:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541197.874857:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 17 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.874867:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 17 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.874881:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7912f6600/0xc9a6a13d3cd1bb66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc9a6a13d3cd1bb5f expref: 17 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.874893:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541197.874931:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf6cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:3314:x1875420968492800:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.874937:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788541197.874993:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:2.0:1788541197.874999:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54f362de-fc37-4008-b51a-09fbe19369bd+13:2358:x1875420945430912:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541197.875006:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541197.875010:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 13 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.875020:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 13 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.875029:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541197.875060:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54f362de-fc37-4008-b51a-09fbe19369bd+13:2358:x1875420945430912:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.875073:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:3.0:1788541197.875190:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e59d638-365e-4b5a-a31c-1933ab9279a7:3314:1875420968492800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541197.875330:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7ae161c00/0xc9a6a13d3cd1be45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a27 expref: 12 pid: 14425 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541197.875340:0:16541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968491904:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541197.883022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541197.883158:0:16541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adf55500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875420968492032:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541197.883204:0:16541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541197.885132:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431040 00000100:00100000:2.0:1788541197.885148:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431040 00010000:00010000:2.0:1788541197.885203:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541197.885379:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788541197.885390:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54f362de-fc37-4008-b51a-09fbe19369bd+12:2358:x1875420945431040:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541197.885440:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541197.885457:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885472:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885491:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1be0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19c5 expref: 12 pid: 14426 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885512:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885522:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885541:0:14417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885549:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885576:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885583:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885589:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179c00 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:2.0:1788541197.885594:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.885603:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.887618:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541197.887641:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541197.887725:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54f362de-fc37-4008-b51a-09fbe19369bd+11:2358:x1875420945431040:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 2332us (4710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541197.887736:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00010000:00010000:0.0:1788541197.888153:0:16541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.888164:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541197.888170:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98d7c2179c00/0xc9a6a13d3cd1be6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541198.301035:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968492928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541198.301118:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541198.301307:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968492928 00000100:00100000:3.0:1788541198.301315:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968492928 00000100:00100000:2.0:1788541198.303698:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541198.303716:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968492928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541198.303753:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541198.305563:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968492928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1848us (4438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541198.305576:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541198.306608:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968492928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788541198.743866:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788541198.935766:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541198.935773:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d786415800 from 10 10000000:01000000:0.0:1788541198.935787:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541198.935836:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.935865:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.935876:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541198.935903:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.935986:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541198.936055:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d790f1a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541198.937715:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493056 00000100:00100000:3.0:1788541198.937729:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493056 00000100:00100000:3.0:1788541198.937806:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788541198.937817:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+16:14428:x1875420968493056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541198.937834:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541198.937853:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1be7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1be76 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541198.937881:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1be7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1be76 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541198.937892:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7c2179000/0xc9a6a13d3cd1be7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1be76 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541198.937902:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179000, rc 0) 00000100:00100000:3.0:1788541198.938136:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad6c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:14428:x1875420968493056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541198.938144:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788541198.938698:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541198.938717:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be7d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.938728:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1be7d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541198.938805:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.938843:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541198.938926:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d790f1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541198.948325:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493184 00000100:00100000:2.0:1788541198.948341:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493184 00000100:00100000:3.0:1788541198.948498:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788541198.948508:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:14428:x1875420968493184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541198.948809:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:14428:x1875420968493184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (9965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541198.948817:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788541198.948973:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.949019:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.949063:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541198.949108:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d790f1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541198.949284:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493312 00000100:00100000:2.0:1788541198.949289:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493312 00000100:00100000:2.0:1788541198.949325:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541198.949332:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:14428:x1875420968493312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541198.949521:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:14428:x1875420968493312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541198.949529:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788541198.949678:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541198.953337:0:16563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788541198.963051:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788541198.963099:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541198.963118:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be7d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.963130:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7ae160c00/0xc9a6a13d3cd1be76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be7d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541198.963140:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541198.963143:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d7901d2000 from 10 10000000:01000000:0.0:1788541198.963146:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541198.963185:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.963193:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.963204:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541198.963230:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.963301:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541198.963350:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7ae0c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788541198.967614:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493440 00000100:00100000:2.0:1788541198.967630:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493440 00000100:00100000:2.0:1788541198.967685:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788541198.967695:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+17:14428:x1875420968493440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541198.967711:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541198.967728:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf603200/0xc9a6a13d3cd1be8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1be84 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.967755:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf603200/0xc9a6a13d3cd1be8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1be84 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.967767:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf603200/0xc9a6a13d3cd1be8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1be84 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.967776:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603200, rc 0) 00000100:00100000:2.0:1788541198.967886:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968493440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (4585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541198.967892:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788541198.967962:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ad2b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541198.967980:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be8b expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.968005:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1be8b expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541198.968089:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541198.968123:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541198.968150:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541198.973119:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493568 00000100:00100000:1.0:1788541198.973135:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493568 00000100:00100000:1.0:1788541198.973185:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788541198.973194:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968493568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541198.973494:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968493568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (5369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541198.973508:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541198.974665:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541198.974717:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541198.974772:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541198.974818:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541198.976279:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493696 00000100:00100000:1.0:1788541198.976291:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493696 00000100:00100000:1.0:1788541198.976354:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788541198.976364:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968493696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541198.976623:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968493696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541198.976631:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788541198.976799:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788541198.978748:0:16564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788541198.980604:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788541198.980640:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541198.980652:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be8b expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.980665:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7ae161600/0xc9a6a13d3cd1be84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be8b expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541198.980677:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541198.980679:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98d682549800 from 10 10000000:01000000:2.0:1788541198.980682:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541198.980722:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.980730:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.980754:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541198.980787:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541198.980855:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541198.980904:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541198.982789:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493824 00000100:00100000:0.0:1788541198.982801:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493824 00000100:00100000:0.0:1788541198.982867:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788541198.982877:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+18:14428:x1875420968493824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541198.982894:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541198.982911:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7ae161e00/0xc9a6a13d3cd1be99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc9a6a13d3cd1be92 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.982965:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7ae161e00/0xc9a6a13d3cd1be99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1be92 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.982976:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7ae161e00/0xc9a6a13d3cd1be99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc9a6a13d3cd1be92 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.982984:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161e00, rc 0) 00000100:00100000:0.0:1788541198.983048:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968493824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (2192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541198.983054:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788541198.983841:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541198.983862:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be99 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541198.983872:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc9a6a13d3cd1be99 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541198.983960:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541198.984002:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541198.984035:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541198.988144:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968493952 00000100:00100000:0.0:1788541198.988160:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968493952 00000100:00100000:0.0:1788541198.988228:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788541198.988239:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968493952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.988564:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968493952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541198.988572:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788541198.989497:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada13b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968493952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541198.989558:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968494080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541198.989619:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541198.989659:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d787cbe900 going to sleep for 11 seconds 00000100:00100000:0.0:1788541198.990534:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494080 00000100:00100000:0.0:1788541198.990544:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494080 00000100:00100000:0.0:1788541198.990591:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541198.990599:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968494080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541198.990824:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:14428:x1875420968494080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541198.990832:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541198.990885:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e59d638-365e-4b5a-a31c-1933ab9279a7:14428:1875420968494080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788541198.991575:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788541198.991619:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788541198.991639:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541198.991649:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be99 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541198.991660:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.159@tcp lock: ffff98d7bf603400/0xc9a6a13d3cd1be92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc9a6a13d3cd1be99 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541199.129580:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788541199.163852:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541199.174605:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431168 00000100:00100000:0.0:1788541199.174620:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431168 00000100:00100000:1.0:1788541199.174755:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:1.0:1788541199.174766:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+11:13755:x1875420945431168:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541199.174792:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541199.174813:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1bea0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a58 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541199.174845:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1bea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a58 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541199.174857:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7999bd200/0xc9a6a13d3cd1bea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a58 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541199.174867:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd200, rc 0) 00000100:00100000:1.0:1788541199.174952:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+12:13755:x1875420945431168:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 187us (11110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541199.174960:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 114 00000100:00100000:1.0:1788541199.182668:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541199.188565:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431296 00000100:00100000:0.0:1788541199.188581:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431296 00000100:00100000:0.0:1788541199.188641:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:0.0:1788541199.188652:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+12:13755:x1875420945431296:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541199.193084:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+12:13755:x1875420945431296:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 4409us (10398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541199.193100:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 115 00000100:00100000:1.0:1788541199.198324:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541199.198363:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431424 00000100:00100000:1.0:1788541199.198375:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431424 00000100:00100000:1.0:1788541199.199253:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:1.0:1788541199.199268:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+12:13755:x1875420945431424:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541199.199535:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+12:13755:x1875420945431424:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 270us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541199.199544:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 116 00000100:00100000:0.0:1788541199.226127:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541199.226243:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431552 00000100:00100000:2.0:1788541199.226254:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431552 00000100:00100000:2.0:1788541199.226315:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:2.0:1788541199.226325:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+12:13755:x1875420945431552:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541199.226341:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541199.226361:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1bea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a5f expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541199.226389:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1bea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a5f expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541199.226472:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98d7bf602000/0xc9a6a13d3cd1bea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a5f expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541199.226481:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602000, rc 0) 00000100:00100000:2.0:1788541199.226540:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:13755:x1875420945431552:12345-192.168.202.59@tcp:101:ll_cfg_requeue.0 Request processed in 216us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541199.226546:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 117 00000100:00100000:2.0:1788541199.232985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541199.233099:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431680 00000100:00100000:0.0:1788541199.233110:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431680 00000100:00100000:0.0:1788541199.233168:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:0.0:1788541199.233179:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+13:13755:x1875420945431680:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541199.233497:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+13:13755:x1875420945431680:12345-192.168.202.59@tcp:501:ll_cfg_requeue.0 Request processed in 317us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541199.233505:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 118 00000100:00100000:3.0:1788541199.258828:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541199.258859:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431808 00000100:00100000:3.0:1788541199.258869:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431808 00000100:00100000:3.0:1788541199.258914:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 119 00000100:00100000:3.0:1788541199.258923:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+13:13755:x1875420945431808:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541199.259273:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54f362de-fc37-4008-b51a-09fbe19369bd+13:13755:x1875420945431808:12345-192.168.202.59@tcp:503:ll_cfg_requeue.0 Request processed in 349us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541199.259281:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 119 00010000:00010000:3.0:1788541199.768528:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541200.006540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541200.006579:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541200.006608:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541200.006626:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541200.006648:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541200.006668:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541200.006700:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432192 00000100:00100000:0.0:1788541200.006709:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432192 00000100:00100000:0.0:1788541200.006757:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432448 00000100:00100000:0.0:1788541200.006761:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432448 00000100:00100000:0.0:1788541200.006843:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432064 00000100:00100000:0.0:1788541200.006847:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432064 00000100:00100000:0.0:1788541200.006860:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432576 00000100:00100000:0.0:1788541200.006862:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432576 00000100:00100000:0.0:1788541200.006876:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1788541200.006884:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2358:x1875420945432192:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541200.006955:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2358:x1875420945432192:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 71us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541200.006963:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1788541200.006978:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1788541200.006984:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2358:x1875420945432448:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541200.007007:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2358:x1875420945432448:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541200.007013:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1788541200.007023:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788541200.007029:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2358:x1875420945432064:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541200.007051:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2358:x1875420945432064:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541200.007065:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788541200.007076:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1788541200.007082:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2358:x1875420945432576:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541200.007105:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2358:x1875420945432576:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541200.007111:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1788541200.007450:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945431936 00000100:00100000:2.0:1788541200.007456:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945431936 00000100:00100000:2.0:1788541200.007484:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432320 00000100:00100000:2.0:1788541200.007487:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432320 00000100:00100000:2.0:1788541200.007513:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541200.007520:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2358:x1875420945431936:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541200.007561:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2358:x1875420945431936:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 42us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541200.007567:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541200.007582:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:2.0:1788541200.007587:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ad2b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2358:x1875420945432320:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541200.007611:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ad2b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2358:x1875420945432320:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 23us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541200.007616:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00080000:2.0:1788541200.007639:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541200.007643:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541200.007645:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788541200.797180:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541201.815649:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541202.839621:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541202.904208:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968494208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541202.904292:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541202.904616:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494208 00000100:00100000:0.0:1788541202.904624:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494208 00000100:00100000:0.0:1788541202.904688:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541202.904711:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968494208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541202.904768:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541202.904817:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875420968494208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541202.904824:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541202.905154:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1875420968494208:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788541202.905229:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541202.905436:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968494464:0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905474:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541202.905503:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541202.905509:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968494592:0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905535:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541202.905571:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968494336:0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905628:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541202.905650:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968494848:0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905670:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541202.905688:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541202.905693:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968494720:0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905714:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541202.905753:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494592 00000100:00100000:3.0:1788541202.905759:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494592 00000100:00100000:3.0:1788541202.905794:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494848 00000100:00100000:3.0:1788541202.905797:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494848 00000100:00100000:3.0:1788541202.905815:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494720 00000100:00100000:3.0:1788541202.905818:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494720 00000100:00100000:3.0:1788541202.905837:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541202.905843:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968494592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905882:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875420968494592:12345-0@lo:400:kworker.0 Request processed in 39us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541202.905889:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541202.905902:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541202.905907:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968494848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905936:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968494848:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541202.905942:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541202.905953:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788541202.905959:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968494720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541202.905983:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968494720:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541202.905989:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541202.906208:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494464 00000100:00100000:1.0:1788541202.906213:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494464 00000100:00100000:1.0:1788541202.906243:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788541202.906251:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968494464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541202.906286:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968494464:12345-0@lo:400:kworker.0 Request processed in 36us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541202.906293:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788541202.906342:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875420968494592:0@lo:400:kworker.0 00000100:00100000:1.0:1788541202.906353:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968494464:0@lo:400:kworker.0 00000100:00100000:1.0:1788541202.906385:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968494720:0@lo:400:kworker.0 00000100:00100000:1.0:1788541202.906430:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968494848:0@lo:400:kworker.0 00000100:00080000:3.0:1788541202.906530:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541202.906535:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541202.906603:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968494336 00000100:00100000:2.0:1788541202.906608:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968494336 00000100:00100000:2.0:1788541202.906641:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788541202.906648:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6812d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968494336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541202.906691:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6812d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968494336:12345-0@lo:400:kworker.0 Request processed in 44us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541202.906698:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788541202.906841:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7adc29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968494336:0@lo:400:kworker.0 00000100:00100000:0.0:1788541203.105824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.105923:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432704 00000100:00100000:3.0:1788541203.105934:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432704 00000100:00100000:3.0:1788541203.106015:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:3.0:1788541203.106026:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:14414:x1875420945432704:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541203.106046:0:16301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541203.106066:0:16301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1beae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a66 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106148:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106163:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106176:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106190:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106197:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106204:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106550:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1bec3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106560:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1bec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106568:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1bec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541203.106592:0:16301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541203.106595:0:16301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541203.106630:0:16301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1bec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106652:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106658:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106665:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106671:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2178c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541203.106676:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106683:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106696:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:3.0:1788541203.106699:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541203.106703:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106710:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1beb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106725:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106731:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106737:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106761:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541203.106771:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106777:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106785:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff98d78320dd00) 00010000:00010000:3.0:1788541203.106788:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541203.106791:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106796:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bebc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106831:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1beae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a66 expref: 8 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106845:0:16301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179c00/0xc9a6a13d3cd1bec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a66 expref: 7 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.106852:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d78320d600) 00010000:00010000:3.0:1788541203.106854:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541203.106856:0:16301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179c00, rc 0) 00000100:00080000:0.0:1788541203.106998:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541203.107099:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:14414:x1875420945432704:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 1074us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541203.107107:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:2.0:1788541203.134446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.134590:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945432960 00000100:00100000:0.0:1788541203.134601:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945432960 00000100:00100000:0.0:1788541203.134659:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:0.0:1788541203.134668:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:14414:x1875420945432960:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541203.134688:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.134710:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1beca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a6d expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.134792:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.134821:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.134834:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.134851:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.134857:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.134864:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135170:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160800/0xc9a6a13d3cd1bedf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135178:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160800/0xc9a6a13d3cd1bedf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135185:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160800/0xc9a6a13d3cd1bedf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.135194:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788541203.135389:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135583:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135591:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135605:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.135610:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135619:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135634:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff98d78320d600) 00010000:00010000:0.0:1788541203.135638:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.135644:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135650:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bed1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135665:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135671:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135677:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135682:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.135686:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135692:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135711:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff98d783b8b700) 00010000:00010000:0.0:1788541203.135714:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.135718:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.135724:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bed8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.136216:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1beca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a6d expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.136246:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160800/0xc9a6a13d3cd1bedf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a6d expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.136254:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d783b8b100) 00010000:00010000:0.0:1788541203.136257:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.136259:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160800, rc 0) 00000100:00100000:0.0:1788541203.138727:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14414:x1875420945432960:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 4045us (4313us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788541203.138750:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1788541203.169376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.169943:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433088 00000100:00100000:3.0:1788541203.169969:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433088 00000100:00100000:3.0:1788541203.170089:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1788541203.170102:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14414:x1875420945433088:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788541203.170220:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14414:x1875420945433088:12345-192.168.202.59@tcp:59:lhsmtool_posix.0 Request processed in 121us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541203.170228:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1788541203.188805:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.189044:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433216 00000100:00100000:2.0:1788541203.189053:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433216 00000100:00100000:2.0:1788541203.189126:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:2.0:1788541203.189136:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14420:x1875420945433216:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541203.189155:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541203.189176:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1beed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a74 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189441:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189456:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189469:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189499:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189507:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189513:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189701:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189710:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189716:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189722:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541203.189726:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189733:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189755:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:2.0:1788541203.189758:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541203.189763:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189769:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189786:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189792:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189798:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189803:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541203.189805:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189811:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189818:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d786553a00) 00010000:00010000:2.0:1788541203.189820:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541203.189823:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189828:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1befb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189854:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1beed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a74 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189863:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:2.0:1788541203.189866:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541203.189873:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1beed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a74 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.189883:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603800, rc 0) 00000100:00100000:2.0:1788541203.189948:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14420:x1875420945433216:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 813us (1151us total) trans 0 rc 301/301 00000100:00100000:2.0:1788541203.189955:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:0.0:1788541203.197019:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.197201:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433344 00000100:00100000:2.0:1788541203.197211:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433344 00000100:00100000:2.0:1788541203.197265:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1788541203.197275:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14420:x1875420945433344:12345-192.168.202.59@tcp:700:lfs.0 00000100:00100000:2.0:1788541203.197363:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14420:x1875420945433344:12345-192.168.202.59@tcp:700:lfs.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541203.197370:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1788541203.203922:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.204085:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433600 00000100:00100000:2.0:1788541203.204095:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433600 00000100:00100000:2.0:1788541203.204157:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1788541203.204168:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14420:x1875420945433600:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:2.0:1788541203.204226:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541203.204252:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1be30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac19ef expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.204275:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:2.0:1788541203.204281:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541203.204557:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.204572:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 5 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.204589:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.204623:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 5 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.204637:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 5 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541203.204652:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada12300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14432:1875420968494976:192.168.202.59@tcp:104: 00000100:00100000:2.0:1788541203.205037:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519840 going to sleep for 11 seconds 00000100:00100000:0.0:1788541203.211072:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541203.211439:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433728 00000100:00100000:1.0:1788541203.211449:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433728 00010000:00010000:1.0:1788541203.211496:0:14418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541203.211536:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:1.0:1788541203.211547:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2359:x1875420945433728:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541203.211561:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541203.211568:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541203.211582:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 6 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541203.211606:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:1.0:1788541203.211612:0:14418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541203.211622:0:14418:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541203.211630:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541203.211651:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541203.211716:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2359:x1875420945433728:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 171us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541203.211748:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00080000:0.0:1788541203.212219:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541203.216495:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1be68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a51 expref: 5 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541203.216528:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada12300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14432:1875420968494976:192.168.202.59@tcp:104: 00010000:00010000:2.0:1788541203.216553:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.216563:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.216569:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.216599:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.216612:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.216636:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541203.218884:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788541203.218916:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.218926:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.218932:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.218937:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541203.218941:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.218948:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.218963:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d78320d300) 00010000:00010000:2.0:1788541203.218967:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541203.218972:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.218978:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541203.218997:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a82d8b65 reply state 0000000070a547c9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541203.219020:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541203.219126:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+10:14420:x1875420945433600:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 14955us (15222us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788541203.219136:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00010000:00010000:2.0:1788541203.222865:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.222884:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.222892:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.222899:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541203.222913:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.222923:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.222940:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d786553a00) 00010000:00010000:2.0:1788541203.222943:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541203.222948:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.222954:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541203.224169:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541203.314765:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.315503:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433856 00000100:00100000:0.0:1788541203.315514:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433856 00000100:00100000:0.0:1788541203.315582:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1788541203.315593:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:14428:x1875420945433856:12345-192.168.202.59@tcp:101:lctl.0 00010000:00010000:0.0:1788541203.315629:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.315651:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1bf10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a7b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.315712:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161a00/0xc9a6a13d3cd1bf17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.315726:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161a00/0xc9a6a13d3cd1bf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.315736:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161a00/0xc9a6a13d3cd1bf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.315777:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788541203.315781:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541203.315815:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161a00/0xc9a6a13d3cd1bf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.315838:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1bf10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a7b expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.315856:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161a00/0xc9a6a13d3cd1bf17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a7b expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.315863:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:0.0:1788541203.315866:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541203.315870:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161a00, rc 0) 00000100:00100000:0.0:1788541203.315939:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+10:14428:x1875420945433856:12345-192.168.202.59@tcp:101:lctl.0 Request processed in 347us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541203.315956:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:0.0:1788541203.352269:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.352638:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945433984 00000100:00100000:3.0:1788541203.352648:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945433984 00000100:00100000:3.0:1788541203.352709:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:3.0:1788541203.352720:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:14429:x1875420945433984:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541203.352748:0:16301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541203.352768:0:16301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a82 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.352832:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bf25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.352848:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bf25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.352860:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bf25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541203.352893:0:16301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788541203.352897:0:16301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541203.352919:0:16301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bf25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.352963:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a82 expref: 7 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.352982:0:16301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179a00/0xc9a6a13d3cd1bf25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a82 expref: 6 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.352992:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:3.0:1788541203.352995:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541203.352999:0:16301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2179a00, rc 0) 00000100:00100000:3.0:1788541203.353064:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:14429:x1875420945433984:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 346us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541203.353072:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:3.0:1788541203.359852:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.359958:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945434112 00000100:00100000:0.0:1788541203.359968:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945434112 00000100:00100000:0.0:1788541203.360028:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1788541203.360038:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:14429:x1875420945434112:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541203.360057:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.360076:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1bf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a89 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360142:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360157:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360169:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360184:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360191:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360197:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360691:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1bf41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360713:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1bf41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360720:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1bf41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.360761:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788541203.360766:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541203.360788:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1bf41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360805:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360811:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360818:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360824:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.360828:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360836:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360847:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:0.0:1788541203.360849:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.360854:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360871:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360885:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360891:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360896:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360900:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.360904:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360909:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360917:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d783b8b300) 00010000:00010000:0.0:1788541203.360920:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.360922:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360928:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360960:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1bf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a89 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360986:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1bf41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a89 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.360993:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d783b8b400) 00010000:00010000:0.0:1788541203.360995:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541203.360997:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160e00, rc 0) 00000100:00100000:0.0:1788541203.361062:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+7:14429:x1875420945434112:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 1026us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541203.361070:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:1.0:1788541203.364051:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.364130:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945434368 00000100:00100000:3.0:1788541203.364139:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945434368 00000100:00100000:3.0:1788541203.364200:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1788541203.364210:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+7:14429:x1875420945434368:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541203.364230:0:16301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541203.364248:0:16301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a90 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541203.364348:0:16301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788541203.364499:0:16301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a90 expref: 9 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.364513:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:3.0:1788541203.364526:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541203.364532:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a90 expref: 9 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.364545:0:16301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2178400, rc 0) 00000100:00100000:3.0:1788541203.364601:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+8:14429:x1875420945434368:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 393us (560us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788541203.364608:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:3.0:1788541203.368697:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.368793:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945434624 00000100:00100000:2.0:1788541203.368804:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945434624 00000100:00100000:2.0:1788541203.368875:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 24 00000100:00100000:2.0:1788541203.368885:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+8:14429:x1875420945434624:12345-192.168.202.59@tcp:36:lfs.0 00010000:00010000:2.0:1788541203.368950:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541203.368976:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1bf41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a89 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.368994:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d783b8b400) 00010000:00010000:2.0:1788541203.369003:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541203.369028:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.369041:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.369052:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541203.369248:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000209e1107 reply state 000000000b87901c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541203.369257:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788541203.369264:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788541203.369355:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+9:14429:x1875420945434624:12345-192.168.202.59@tcp:36:lfs.0 Request processed in 471us (667us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788541203.369362:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 24 00010000:00010000:3.0:1788541203.370930:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.370944:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.370952:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.370958:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541203.370963:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.370970:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.370984:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553a00) 00010000:00010000:3.0:1788541203.370987:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788541203.370992:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.370998:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602200/0xc9a6a13d3cd1bf56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541203.371256:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.371321:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945434880 00000100:00100000:2.0:1788541203.371329:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945434880 00000100:00100000:2.0:1788541203.371378:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:2.0:1788541203.371388:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+8:14429:x1875420945434880:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541203.371615:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+9:14429:x1875420945434880:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 228us (361us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788541203.371622:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:0.0:1788541203.373860:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.373938:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945435136 00000100:00100000:3.0:1788541203.373946:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945435136 00000100:00100000:3.0:1788541203.373999:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:3.0:1788541203.374010:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+9:14429:x1875420945435136:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:3.0:1788541203.374029:0:16301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541203.374047:0:16301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a97 expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374116:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374130:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374141:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374156:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374163:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374170:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541203.374288:0:16301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788541203.374373:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374392:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374553:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374562:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2178c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541203.374567:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374574:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374585:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:3.0:1788541203.374587:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541203.374592:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374598:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1bf64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374613:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374618:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374624:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374628:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2179e00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541203.374637:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374644:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374652:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d78320dd00) 00010000:00010000:3.0:1788541203.374655:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541203.374657:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374663:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1bf6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374701:0:16301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a97 expref: 11 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374710:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:3.0:1788541203.374712:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541203.374716:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1bf5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a97 expref: 11 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.374726:0:16301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7c2178400, rc 0) 00000100:00100000:3.0:1788541203.374837:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+10:14429:x1875420945435136:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 828us (984us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788541203.374844:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 25 00000100:00100000:1.0:1788541203.387008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.387110:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945435264 00000100:00100000:2.0:1788541203.387120:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945435264 00000100:00100000:2.0:1788541203.387181:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1788541203.387192:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+10:14429:x1875420945435264:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541203.387216:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541203.387239:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1a9e expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.387340:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.387354:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.387366:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541203.387576:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788541203.387581:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788541203.387604:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.387630:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1bf79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.387647:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.387671:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:2.0:1788541203.387674:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541203.387677:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602400, rc 0) 00000100:00100000:2.0:1788541203.387747:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:14429:x1875420945435264:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 548us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541203.387755:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 26 00000100:00100000:2.0:1788541203.393856:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.393937:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945435392 00000100:00100000:3.0:1788541203.393947:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945435392 00000100:00100000:3.0:1788541203.394005:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:3.0:1788541203.394016:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:14429:x1875420945435392:12345-192.168.202.59@tcp:37:lfs.0 00000100:00100000:3.0:1788541203.398346:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:14429:x1875420945435392:12345-192.168.202.59@tcp:37:lfs.0 Request processed in 4321us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541203.398359:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 3 00000100:00100000:2.0:1788541203.414913:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.415039:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945435648 00000100:00100000:0.0:1788541203.415048:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945435648 00000100:00100000:0.0:1788541203.415104:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1788541203.415115:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d6818abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:14429:x1875420945435648:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541203.415353:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d6818abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+12:14429:x1875420945435648:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 239us (456us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788541203.415361:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 4 00000100:00100000:0.0:1788541203.415576:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541203.415593:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968495104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541203.415634:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541203.415698:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968495104 00000100:00100000:0.0:1788541203.415703:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968495104 00000100:00100000:0.0:1788541203.415730:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541203.415747:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968495104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541203.415774:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788541203.415828:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968495104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541203.415834:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541203.415877:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968495104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541203.494302:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.495321:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945435776 00000100:00100000:0.0:1788541203.495332:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945435776 00000100:00100000:0.0:1788541203.495401:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:0.0:1788541203.495452:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+10:14435:x1875420945435776:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541203.495473:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.495493:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1aa5 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495560:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495574:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495585:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495599:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495606:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495612:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495716:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161400/0xc9a6a13d3cd1bf9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495725:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161400/0xc9a6a13d3cd1bf9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495732:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161400/0xc9a6a13d3cd1bf9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.495819:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788541203.495823:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541203.495880:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161400/0xc9a6a13d3cd1bf9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495893:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495900:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495907:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495913:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.495917:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495923:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495935:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:0.0:1788541203.495943:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.495948:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495955:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1bf8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495971:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495977:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495982:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495988:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.495991:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.495997:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.496005:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff98d783b8b300) 00010000:00010000:0.0:1788541203.496008:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.496010:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.496016:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bf95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.496047:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bf87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aa5 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.496072:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161400/0xc9a6a13d3cd1bf9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aa5 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.496080:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:0.0:1788541203.496082:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788541203.496085:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161400, rc 0) 00000100:00100000:0.0:1788541203.496152:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+11:14435:x1875420945435776:12345-192.168.202.59@tcp:101:bash.0 Request processed in 704us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541203.496160:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:1.0:1788541203.512528:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.512630:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945436032 00000100:00100000:0.0:1788541203.512640:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945436032 00000100:00100000:0.0:1788541203.512710:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 28 00000100:00100000:0.0:1788541203.512721:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+11:14435:x1875420945436032:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541203.512752:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.512773:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfa3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1aac expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.512917:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.512932:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.512941:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.512976:0:14431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.512998:0:14431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 11 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541203.513193:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14431:1875420968495232:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541203.513567:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb6160c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541203.516536:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.516615:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945436160 00000100:00100000:3.0:1788541203.516624:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945436160 00010000:00010000:3.0:1788541203.516660:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 12 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541203.516700:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1788541203.516711:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+12:2359:x1875420945436160:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541203.516724:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541203.516731:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 12 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.516754:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 12 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.516773:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:3.0:1788541203.516778:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.516781:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1bf80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1a9e expref: 12 pid: 14430 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.516787:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.516794:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541203.516795:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14431:1875420968495232:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541203.516811:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541203.516815:0:14431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.516823:0:14431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.516828:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.516848:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.516857:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.516865:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541203.516870:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:2359:x1875420945436160:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 162us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541203.516877:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00010000:00010000:0.0:1788541203.517852:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517869:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517879:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.517890:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788541203.517918:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517925:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517932:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517938:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.517941:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517949:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517958:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:0.0:1788541203.517961:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.517965:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.517971:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfaa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541203.517982:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000750c7f13 reply state 000000002382211e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541203.517996:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788541203.518029:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfa3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 14 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.518043:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 13 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.518050:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541203.518052:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788541203.518054:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161800, rc 0) 00000100:00100000:0.0:1788541203.518108:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+14:14435:x1875420945436032:12345-192.168.202.59@tcp:101:bash.0 Request processed in 5389us (5590us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788541203.518115:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 28 00010000:00010000:0.0:1788541203.536997:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.537015:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.537023:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.537029:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541203.537034:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.537041:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.537090:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98d783b8b300) 00010000:00010000:0.0:1788541203.537094:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541203.537099:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.537107:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfb1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541203.550605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.550728:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945436288 00000100:00100000:0.0:1788541203.550747:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945436288 00000100:00100000:0.0:1788541203.550810:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:0.0:1788541203.550820:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+13:14435:x1875420945436288:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541203.550845:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.550865:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfc6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1ab3 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.550944:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.550958:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.550971:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.551013:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788541203.551017:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541203.551035:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.551063:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.551102:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfc6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ab3 expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.551122:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ab3 expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.551130:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541203.551133:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541203.551137:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161200, rc 0) 00000100:00100000:0.0:1788541203.551202:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+14:14435:x1875420945436288:12345-192.168.202.59@tcp:101:bash.0 Request processed in 384us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541203.551219:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 29 00000100:00100000:2.0:1788541203.555128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.555293:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945436544 00000100:00100000:0.0:1788541203.555302:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945436544 00000100:00100000:0.0:1788541203.555355:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:0.0:1788541203.555365:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+14:14435:x1875420945436544:12345-192.168.202.59@tcp:35:bash.0 00000100:00100000:0.0:1788541203.555745:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+15:14435:x1875420945436544:12345-192.168.202.59@tcp:35:bash.0 Request processed in 372us (617us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788541203.555753:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 5 00000100:00100000:1.0:1788541203.793540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.793707:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945436800 00000100:00100000:2.0:1788541203.793717:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945436800 00000100:00100000:2.0:1788541203.793776:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1788541203.793786:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+15:14445:x1875420945436800:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:2.0:1788541203.793809:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541203.793830:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1bfd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1aba expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541203.793924:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788541203.794040:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1bfd4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aba expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.794053:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:2.0:1788541203.794084:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541203.794091:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602c00/0xc9a6a13d3cd1bfd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aba expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.794105:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf602c00, rc 0) 00000100:00100000:2.0:1788541203.794165:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+16:14445:x1875420945436800:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 381us (636us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788541203.794172:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 30 00000100:00100000:2.0:1788541203.800688:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.800804:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945437056 00000100:00100000:0.0:1788541203.800814:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945437056 00000100:00100000:0.0:1788541203.800871:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 6 00000100:00100000:0.0:1788541203.800881:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+16:14445:x1875420945437056:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541203.801141:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+17:14445:x1875420945437056:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 261us (461us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788541203.801155:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 6 00010000:00010000:3.0:1788541203.863564:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541203.881588:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.881761:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945437312 00000100:00100000:0.0:1788541203.881771:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945437312 00000100:00100000:0.0:1788541203.881839:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:0.0:1788541203.881851:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+17:14448:x1875420945437312:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541203.881874:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541203.881904:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfe2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1ac1 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.882001:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfe9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.882016:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.882026:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541203.882037:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788541203.882154:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bfe2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ac1 expref: 20 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.882173:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ac1 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.882182:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541203.882196:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541203.882200:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160400, rc 0) 00000100:00100000:0.0:1788541203.882261:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14448:x1875420945437312:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 412us (683us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788541203.882267:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:1.0:1788541203.901851:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541203.901964:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945437440 00000100:00100000:2.0:1788541203.901973:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945437440 00000100:00100000:2.0:1788541203.902028:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:2.0:1788541203.902037:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14448:x1875420945437440:12345-192.168.202.59@tcp:54:lfs.0 00010000:00010000:2.0:1788541203.902099:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902116:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902128:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902152:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902159:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902166:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902187:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf603c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541203.902192:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902201:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902212:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:2.0:1788541203.902215:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541203.902220:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.902227:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603c00/0xc9a6a13d3cd1bff7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541203.902298:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14448:x1875420945437440:12345-192.168.202.59@tcp:54:lfs.0 Request processed in 261us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541203.902305:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:2.0:1788541203.906543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541203.906613:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945437568 00000100:00100000:3.0:1788541203.906621:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945437568 00000100:00100000:3.0:1788541203.906680:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:3.0:1788541203.906689:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:2360:x1875420945437568:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541203.906703:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541203.906724:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1bfe9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ac1 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541203.906754:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:3.0:1788541203.906759:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541203.906810:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+18:2360:x1875420945437568:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 122us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541203.906818:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1788541203.909504:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541203.909590:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945437824 00000100:00100000:0.0:1788541203.909599:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945437824 00000100:00100000:0.0:1788541203.909646:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:0.0:1788541203.909655:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+18:14448:x1875420945437824:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:0.0:1788541203.909879:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14448:x1875420945437824:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 224us (382us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788541203.909887:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 7 00000100:00100000:1.0:1788541204.434379:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541204.434559:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945438080 00000100:00100000:0.0:1788541204.434569:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945438080 00000100:00100000:0.0:1788541204.434680:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:0.0:1788541204.434692:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14479:x1875420945438080:12345-192.168.202.59@tcp:101:cat.0 00010000:00010000:0.0:1788541204.434718:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541204.434767:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bffe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1ac8 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.434864:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c005 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.434879:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.434901:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541204.434931:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788541204.435075:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1bffe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ac8 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.435095:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c005 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ac8 expref: 21 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.435104:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541204.435107:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541204.435111:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160a00, rc 0) 00000100:00100000:0.0:1788541204.435178:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+21:14479:x1875420945438080:12345-192.168.202.59@tcp:101:cat.0 Request processed in 487us (806us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788541204.435185:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 33 00000100:00100000:2.0:1788541204.441111:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541204.441208:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541204.442253:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945438464 00000100:00100000:1.0:1788541204.442266:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945438464 00000100:00100000:1.0:1788541204.442339:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:1.0:1788541204.442350:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+21:2360:x1875420945438464:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541204.442365:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541204.442390:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c005 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ac8 expref: 21 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.442436:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:1.0:1788541204.442442:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541204.443226:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+20:2360:x1875420945438464:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 872us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541204.443236:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 1 00000100:00100000:0.0:1788541204.446076:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945438336 00000100:00100000:0.0:1788541204.446090:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945438336 00000100:00100000:0.0:1788541204.446396:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:0.0:1788541204.446423:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+20:14479:x1875420945438336:12345-192.168.202.59@tcp:35:cat.0 00000100:00100000:0.0:1788541204.446740:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+21:14479:x1875420945438336:12345-192.168.202.59@tcp:35:cat.0 Request processed in 326us (5628us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788541204.446748:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 8 00000100:00100000:2.0:1788541204.567471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541204.567568:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945438720 00000100:00100000:0.0:1788541204.567578:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945438720 00000100:00100000:0.0:1788541204.567649:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:0.0:1788541204.567668:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+21:14485:x1875420945438720:12345-192.168.202.59@tcp:101:dd.0 00010000:00010000:0.0:1788541204.567692:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541204.567724:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c013 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1acf expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.567851:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c01a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.567866:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c01a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.567877:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c01a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541204.567889:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788541204.568034:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c013 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1acf expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.568052:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c01a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1acf expref: 23 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541204.568062:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541204.568065:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541204.568069:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160200, rc 0) 00000100:00100000:0.0:1788541204.568132:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14485:x1875420945438720:12345-192.168.202.59@tcp:101:dd.0 Request processed in 466us (669us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788541204.568140:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 34 00000100:00100000:1.0:1788541204.573253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541204.575556:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945438976 00000100:00100000:3.0:1788541204.575572:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945438976 00000100:00100000:3.0:1788541204.575640:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 35 00000100:00100000:3.0:1788541204.575650:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14485:x1875420945438976:12345-192.168.202.59@tcp:36:dd.0 00010000:00010000:3.0:1788541204.575708:0:16301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788541204.575743:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c01a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1acf expref: 23 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541204.575769:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1bfcd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ab3 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541204.575797:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:3.0:1788541204.575802:0:16301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541204.576011:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541204.576025:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541204.576035:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541204.576086:0:16301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788541204.576122:0:16301:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f563b33c reply state 0000000082e5a64d transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541204.576131:0:16301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541204.576570:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+24:14485:x1875420945438976:12345-192.168.202.59@tcp:36:dd.0 Request processed in 920us (3322us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788541204.576578:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 35 00000020:00080000:3.0:1788541204.576583:0:16301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788541204.582106:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.582133:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.582140:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.582152:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2178400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541204.582157:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.582164:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.582181:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:1.0:1788541204.582185:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541204.582190:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541204.582196:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c028 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541204.750343:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541204.750510:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945439232 00000100:00100000:3.0:1788541204.750521:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945439232 00000100:00100000:3.0:1788541204.750584:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 9 00000100:00100000:3.0:1788541204.750595:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14485:x1875420945439232:12345-192.168.202.59@tcp:35:dd.0 00000100:00100000:3.0:1788541204.750854:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+24:14485:x1875420945439232:12345-192.168.202.59@tcp:35:dd.0 Request processed in 260us (520us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788541204.750861:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 9 00010000:00010000:0.0:1788541204.887809:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541205.093471:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541205.093762:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945439360 00000100:00100000:0.0:1788541205.093772:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945439360 00000100:00100000:0.0:1788541205.093838:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00100000:0.0:1788541205.093848:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+24:14499:x1875420945439360:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:0.0:1788541205.093884:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541205.093912:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c02f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1ad6 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.093973:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.093987:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094000:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094016:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094023:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094029:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094110:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094118:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094125:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541205.094275:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788541205.094285:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541205.094323:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094336:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094343:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094349:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094355:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094361:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541205.094365:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094372:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094384:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:0.0:1788541205.094387:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541205.094392:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094398:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c036 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094468:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094484:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094489:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094494:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541205.094497:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094503:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094511:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98d783b8b300) 00010000:00010000:0.0:1788541205.094514:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541205.094517:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094522:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c03d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094553:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c02f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ad6 expref: 26 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094567:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ad6 expref: 25 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.094574:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541205.094575:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541205.094584:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160200, rc 0) 00000100:00100000:0.0:1788541205.094639:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+25:14499:x1875420945439360:12345-192.168.202.59@tcp:101:stat.0 Request processed in 792us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541205.094646:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 36 00000100:00080000:3.0:1788541205.095040:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541205.119326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541205.119371:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541205.119501:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945439488 00000100:00100000:3.0:1788541205.119513:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945439488 00000100:00100000:3.0:1788541205.119572:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:3.0:1788541205.119582:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+13:2360:x1875420945439488:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541205.119668:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54f362de-fc37-4008-b51a-09fbe19369bd+13:2360:x1875420945439488:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541205.119675:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 121 00000100:00100000:1.0:1788541205.120042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541205.125450:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945439744 00000100:00100000:2.0:1788541205.125465:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945439744 00000100:00080000:0.0:1788541205.126017:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541205.126197:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541205.128903:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945440000 00000100:00100000:2.0:1788541205.128917:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945440000 00000100:00100000:2.0:1788541205.128976:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945439616 00000100:00100000:2.0:1788541205.128980:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945439616 00000100:00100000:2.0:1788541205.129018:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1788541205.129028:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2360:x1875420945439744:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541205.129102:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2360:x1875420945439744:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 76us (9731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541205.129109:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1788541205.129238:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541205.129247:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2360:x1875420945440000:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541205.129272:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2360:x1875420945440000:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 27us (9231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541205.129299:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1788541205.129308:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2360:x1875420945439616:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:1.0:1788541205.129331:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2360:x1875420945439616:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 26us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541205.129343:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1788541205.129399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00080000:0.0:1788541205.129432:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541205.129529:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945439872 00000100:00100000:3.0:1788541205.129535:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945439872 00000100:00100000:2.0:1788541205.129543:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:3.0:1788541205.129583:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:3.0:1788541205.129592:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:2360:x1875420945439872:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541205.129630:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f5d45147-30f1-4e88-b8e5-74d4c60304c2+11:2360:x1875420945439872:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541205.129637:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 27 00000100:00100000:1.0:1788541205.129734:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00080000:0.0:1788541205.129774:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541205.129922:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945440128 00000100:00100000:2.0:1788541205.129927:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945440128 00000100:00100000:2.0:1788541205.129971:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:2.0:1788541205.129978:0:15115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2360:x1875420945440128:12345-192.168.202.59@tcp:400:kworker.0 00000100:00080000:0.0:1788541205.130030:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541205.130247:0:15115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2360:x1875420945440128:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 268us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541205.130255:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:1.0:1788541205.162122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541205.162454:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945440384 00000100:00100000:2.0:1788541205.162464:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945440384 00000100:00100000:2.0:1788541205.162524:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 37 00000100:00100000:2.0:1788541205.162534:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+25:14505:x1875420945440384:12345-192.168.202.59@tcp:36:truncate.0 00010000:00010000:2.0:1788541205.162608:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541205.162633:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c044 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ad6 expref: 25 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.162672:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:2.0:1788541205.162678:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541205.162892:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.162904:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.162911:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541205.162949:0:14430:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788541205.162968:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000409961e1 reply state 000000004aebfb6b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541205.162984:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541205.163108:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+27:14505:x1875420945440384:12345-192.168.202.59@tcp:36:truncate.0 Request processed in 576us (996us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788541205.163114:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 37 00000020:00080000:2.0:1788541205.163118:0:14430:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788541205.165881:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.165901:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.165906:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.165910:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541205.165914:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.165919:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.165931:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541205.165933:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541205.165937:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.165941:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602400/0xc9a6a13d3cd1c04b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541205.328543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541205.338312:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945440512 00000100:00100000:3.0:1788541205.338329:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945440512 00000100:00100000:3.0:1788541205.338454:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:3.0:1788541205.338464:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+26:14519:x1875420945440512:12345-192.168.202.59@tcp:101:stat.0 00010000:00010000:3.0:1788541205.338489:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541205.338509:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1c052 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1add expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.338575:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.338589:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.338991:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339013:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339021:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339029:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339283:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339293:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339300:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541205.339345:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788541205.339350:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541205.339371:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339382:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339389:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339403:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339429:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339435:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2178c00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541205.339439:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339446:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339458:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:3.0:1788541205.339461:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541205.339465:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339472:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178c00/0xc9a6a13d3cd1c059 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339487:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339493:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339497:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339502:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7c2178400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541205.339510:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339516:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339523:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98d78320d700) 00010000:00010000:3.0:1788541205.339525:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541205.339528:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339533:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2178400/0xc9a6a13d3cd1c060 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339566:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7c2179e00/0xc9a6a13d3cd1c052 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 28 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339582:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 27 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.339589:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:3.0:1788541205.339592:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541205.339595:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cca00, rc 0) 00000100:00100000:3.0:1788541205.339779:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+27:14519:x1875420945440512:12345-192.168.202.59@tcp:101:stat.0 Request processed in 1315us (11245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541205.339788:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 38 00000100:00100000:2.0:1788541205.512708:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541205.512943:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945440768 00000100:00100000:0.0:1788541205.512966:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945440768 00000100:00100000:0.0:1788541205.513032:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:0.0:1788541205.513053:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+27:14529:x1875420945440768:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541205.513075:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541205.513100:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c06e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1ae4 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541205.513209:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788541205.513321:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c06e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ae4 expref: 29 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.513335:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:0.0:1788541205.513338:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541205.513343:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c06e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1ae4 expref: 29 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.513357:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160600, rc 0) 00000100:00100000:0.0:1788541205.513536:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+28:14529:x1875420945440768:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 494us (837us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788541205.513543:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 39 00000100:00100000:1.0:1788541205.516771:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541205.516900:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945441024 00000100:00100000:3.0:1788541205.516910:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945441024 00000100:00100000:3.0:1788541205.516972:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:3.0:1788541205.516993:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bc702850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+28:14529:x1875420945441024:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:3.0:1788541205.517236:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bc702850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+29:14529:x1875420945441024:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 255us (475us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788541205.517243:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 10 00000100:00100000:1.0:1788541205.596180:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541205.596350:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945441280 00000100:00100000:0.0:1788541205.596361:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945441280 00000100:00100000:0.0:1788541205.596470:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:0.0:1788541205.596482:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+29:14535:x1875420945441280:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541205.596506:0:16301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541205.596526:0:16301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c07c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1aeb expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.596809:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.596824:0:16301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.596833:0:16301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 30 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.596841:0:16301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.596875:0:16301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 30 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.596901:0:16301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 30 pid: 14432 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541205.596915:0:16301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968495360:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541205.597014:0:16301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.597024:0:16301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541205.597031:0:16301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968495488:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541205.597066:0:16301:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541205.601076:0:16301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968495360:192.168.202.59@tcp:104: 00000100:00100000:1.0:1788541205.602863:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541205.603049:0:16301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968495488:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541205.603076:0:16301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541205.603861:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945441408 00000100:00100000:2.0:1788541205.603870:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945441408 00010000:00010000:2.0:1788541205.603919:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 31 pid: 14432 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541205.603960:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:2.0:1788541205.603971:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7a0b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:2359:x1875420945441408:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541205.604002:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541205.604009:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 31 pid: 14432 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.604023:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 31 pid: 14432 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.604046:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c067 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1add expref: 31 pid: 14432 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.604064:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:2.0:1788541205.604069:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.604078:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.604085:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541205.604192:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7a0b88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:2359:x1875420945441408:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 222us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541205.604200:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1788541205.609124:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541205.610784:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945441536 00000100:00100000:1.0:1788541205.610797:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945441536 00010000:00010000:1.0:1788541205.610840:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541205.610878:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1788541205.610895:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:2359:x1875420945441536:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541205.610907:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541205.610913:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.610925:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.610944:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1bfb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aac expref: 30 pid: 14431 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.610959:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:1.0:1788541205.610976:0:14416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.610986:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.610994:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.611030:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541205.611158:0:16301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.611166:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541205.611183:0:16301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788541205.611345:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c07c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 31 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.611380:0:16301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 30 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.611388:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:3.0:1788541205.611390:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541205.611393:0:16301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161c00, rc 0) 00000100:00100000:1.0:1788541205.611479:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:2359:x1875420945441536:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 585us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541205.611487:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788541205.615286:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+29:14535:x1875420945441280:12345-192.168.202.59@tcp:101:bash.0 Request processed in 18797us (19105us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788541205.615315:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 40 00000100:00100000:3.0:1788541205.618988:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541205.619080:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945441792 00000100:00100000:2.0:1788541205.619090:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945441792 00000100:00100000:2.0:1788541205.619184:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 41 00000100:00100000:2.0:1788541205.619194:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+29:14535:x1875420945441792:12345-192.168.202.59@tcp:36:bash.0 00010000:00010000:2.0:1788541205.619776:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.619809:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541205.619822:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541205.619879:0:14431:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788541205.619984:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000db88edd reply state 000000006962b30b transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541205.619993:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541205.620133:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14535:x1875420945441792:12345-192.168.202.59@tcp:36:bash.0 Request processed in 940us (1154us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788541205.620141:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 41 00000020:00080000:2.0:1788541205.620145:0:14431:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788541205.625008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:1.0:1788541205.628064:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.628082:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.628090:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.628095:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf602800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541205.628100:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.628109:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.628125:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:1.0:1788541205.628129:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541205.628134:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.628157:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf602800/0xc9a6a13d3cd1c091 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541205.628557:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945441920 00000100:00100000:3.0:1788541205.628568:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945441920 00000100:00100000:3.0:1788541205.628744:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:3.0:1788541205.628756:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14535:x1875420945441920:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541205.628782:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541205.628800:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c098 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1af2 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.628863:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c098 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1af2 expref: 32 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.628877:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c098 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1af2 expref: 32 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.628905:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:3.0:1788541205.628908:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541205.628910:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd000, rc 0) 00000100:00100000:3.0:1788541205.628978:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14535:x1875420945441920:12345-192.168.202.59@tcp:101:bash.0 Request processed in 225us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541205.628985:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 42 00000100:00100000:1.0:1788541205.637273:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541205.637804:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442048 00000100:00100000:0.0:1788541205.637815:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442048 00000100:00100000:0.0:1788541205.637879:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:0.0:1788541205.637898:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14535:x1875420945442048:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:0.0:1788541205.637917:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541205.637936:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c09f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1af9 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.638016:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.638030:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 33 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.638038:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.638071:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 33 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.638085:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 33 pid: 16301 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541205.638099:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1875420968495616:192.168.202.59@tcp:104: 00000100:00100000:0.0:1788541205.638181:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb616c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541205.643552:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541205.643596:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442176 00000100:00100000:1.0:1788541205.643606:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442176 00010000:00010000:1.0:1788541205.643645:0:14418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 34 pid: 16301 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541205.643680:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1788541205.643690:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+34:2359:x1875420945442176:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541205.643705:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541205.643712:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 34 pid: 16301 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.643735:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 34 pid: 16301 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.643757:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:1.0:1788541205.643762:0:14418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.643772:0:14418:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.643780:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541205.643817:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541205.643870:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+34:2359:x1875420945442176:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 179us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541205.643877:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00010000:00010000:0.0:1788541205.645196:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c083 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1aeb expref: 33 pid: 16301 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541205.645245:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1875420968495616:192.168.202.59@tcp:104: 00010000:00010000:0.0:1788541205.645267:0:14430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.645277:0:14430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.645282:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541205.645328:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788541205.645332:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541205.645354:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.645573:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c09f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1af9 expref: 33 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.645659:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1af9 expref: 32 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.645668:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:0.0:1788541205.645671:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541205.645674:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161000, rc 0) 00000100:00100000:0.0:1788541205.645744:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14535:x1875420945442048:12345-192.168.202.59@tcp:101:bash.0 Request processed in 7847us (8480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541205.645751:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 43 00000100:00100000:1.0:1788541205.651199:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541205.651292:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442432 00000100:00100000:3.0:1788541205.651302:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442432 00000100:00100000:3.0:1788541205.651366:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1788541205.651384:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14535:x1875420945442432:12345-192.168.202.59@tcp:103:bash.0 00010000:00010000:3.0:1788541205.651439:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788541205.651462:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161000/0xc9a6a13d3cd1c0a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1af9 expref: 32 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.651481:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c098 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1af2 expref: 31 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.651491:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b800) 00010000:00010000:3.0:1788541205.651500:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541205.651563:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:14535:x1875420945442432:12345-192.168.202.59@tcp:103:bash.0 Request processed in 188us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541205.651570:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 2 00000100:00100000:3.0:1788541205.654439:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541205.654549:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442560 00000100:00100000:0.0:1788541205.654558:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442560 00000100:00100000:0.0:1788541205.654613:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:0.0:1788541205.654622:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:14535:x1875420945442560:12345-192.168.202.59@tcp:58:bash.0 00010000:00010000:0.0:1788541205.654709:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.654733:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541205.654744:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541205.655519:0:16301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541205.655662:0:16301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788541205.655744:0:16301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788541205.655848:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:14535:x1875420945442560:12345-192.168.202.59@tcp:58:bash.0 Request processed in 1224us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541205.655857:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 44 00000100:00100000:0.0:1788541205.659291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541205.659400:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442688 00000100:00100000:3.0:1788541205.659433:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442688 00000100:00100000:3.0:1788541205.659482:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 45 00000100:00100000:3.0:1788541205.659491:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+30:14535:x1875420945442688:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:3.0:1788541205.659510:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541205.659541:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b00 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.659609:0:14431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.659621:0:14431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 31 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.659656:0:14431:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.659669:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 31 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.659683:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:3.0:1788541205.659686:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541205.659690:0:14431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 31 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541205.659698:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd800, rc 0) 00000100:00100000:3.0:1788541205.659771:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14535:x1875420945442688:12345-192.168.202.59@tcp:101:bash.0 Request processed in 280us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541205.659778:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 45 00010000:00010000:3.0:1788541205.911542:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541206.296390:0:14464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788541206.296401:0:14464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541206.296459:0:14464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788541206.296468:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788541206.296604:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14464:1875420968495744:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541206.296709:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d786b34480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541206.308215:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541206.309269:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442816 00000100:00100000:2.0:1788541206.309281:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442816 00000100:00100000:2.0:1788541206.309335:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1788541206.309345:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14536:x1875420945442816:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788541206.309540:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14536:x1875420945442816:12345-192.168.202.59@tcp:900:lhsmtool_posix.0 Request processed in 186us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541206.309549:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:1.0:1788541206.311001:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2fd0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14464:1875420968495744:192.168.202.59@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541206.324140:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.324228:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945442944 00000100:00100000:0.0:1788541206.324238:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945442944 00000100:00100000:0.0:1788541206.324300:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1788541206.324310:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14536:x1875420945442944:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541206.324342:0:16301:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541206.324799:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14536:x1875420945442944:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 488us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.324808:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 46 00000100:00100000:0.0:1788541206.349494:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.349596:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945443072 00000100:00100000:3.0:1788541206.349607:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945443072 00000100:00100000:3.0:1788541206.349666:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:3.0:1788541206.349677:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14536:x1875420945443072:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.349758:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349774:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349796:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349825:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349833:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349839:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349860:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349867:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349873:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541206.349914:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788541206.349918:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788541206.349931:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349941:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349948:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349955:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349970:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.349975:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349983:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.349996:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d783b8b100) 00010000:00010000:3.0:1788541206.349999:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541206.350003:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350009:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c0bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350022:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350028:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350034:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350039:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.350042:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350047:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350064:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff98d78320d700) 00010000:00010000:3.0:1788541206.350066:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541206.350069:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350075:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350088:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350093:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350098:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350103:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cca00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.350106:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350112:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350117:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:3.0:1788541206.350119:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541206.350122:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.350127:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.350205:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14536:x1875420945443072:12345-192.168.202.59@tcp:34:lhsmtool_posix.0 Request processed in 530us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541206.350213:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 47 00000100:00100000:1.0:1788541206.391853:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.391998:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945443328 00000100:00100000:3.0:1788541206.392009:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945443328 00000100:00100000:3.0:1788541206.392074:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:3.0:1788541206.392085:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+31:14536:x1875420945443328:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.392106:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541206.392124:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b07 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392245:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392260:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392272:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541206.392283:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788541206.392389:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392397:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392404:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392457:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.392461:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392469:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392482:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:3.0:1788541206.392485:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541206.392490:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392496:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392802:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0d0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b07 expref: 33 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392814:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff98d783b8b100) 00010000:00010000:3.0:1788541206.392816:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541206.392820:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b07 expref: 33 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.392830:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cca00, rc 0) 00000100:00100000:2.0:1788541206.393005:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14536:x1875420945443328:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 921us (1164us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788541206.393014:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 48 00000100:00100000:2.0:1788541206.402002:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.402094:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945443456 00000100:00100000:3.0:1788541206.402104:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945443456 00000100:00100000:3.0:1788541206.402162:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:3.0:1788541206.402171:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7bf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14536:x1875420945443456:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788541206.402225:0:14431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788541206.402334:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7bf4c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14536:x1875420945443456:12345-192.168.202.59@tcp:53:lhsmtool_posix.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541206.402341:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 49 00000100:00100000:0.0:1788541206.406186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.407182:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945443712 00000100:00100000:3.0:1788541206.407193:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945443712 00000100:00100000:3.0:1788541206.407265:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:3.0:1788541206.407276:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+32:14536:x1875420945443712:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.407296:0:16301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541206.407316:0:16301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b0e expref: -99 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541206.408502:0:16301:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1788541206.408510:0:16301:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788541206.408563:0:16301:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788541206.408843:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1c0ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.408859:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1c0ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.408870:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1c0ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.409312:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c0e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b0e expref: 35 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.409332:0:16301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1c0ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b0e expref: 34 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.409341:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d786553e00) 00010000:00010000:2.0:1788541206.409344:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541206.409746:0:16301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf603800, rc 0) 00000100:00100000:2.0:1788541206.409823:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+34:14536:x1875420945443712:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 2548us (3644us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788541206.409832:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 50 00000100:00100000:1.0:1788541206.436027:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.436180:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945443968 00000100:00100000:3.0:1788541206.436190:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945443968 00000100:00100000:3.0:1788541206.436260:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:3.0:1788541206.436271:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+34:14536:x1875420945443968:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.436335:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541206.436375:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf603800/0xc9a6a13d3cd1c0ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b0e expref: 34 pid: 16301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436397:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d786553e00) 00010000:00010000:3.0:1788541206.436457:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541206.436483:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436497:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436525:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436541:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436547:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436554:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436621:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436629:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436636:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436642:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.436646:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436653:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436663:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:3.0:1788541206.436666:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541206.436670:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436684:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c0fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436695:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436701:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436706:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436742:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.436746:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436752:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436761:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3975cf53 (ffff98d78320d700) 00010000:00010000:3.0:1788541206.436764:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541206.436767:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.436773:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c101 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3975cf53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.438045:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+33:14536:x1875420945443968:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 1768us (2021us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541206.438055:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 51 00000100:00100000:2.0:1788541206.455395:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.455513:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945444096 00000100:00100000:0.0:1788541206.455524:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945444096 00000100:00100000:0.0:1788541206.455584:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:0.0:1788541206.455594:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+33:14536:x1875420945444096:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541206.455615:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541206.455639:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c108 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b15 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.455675:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c10f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.455689:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c10f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.455701:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c10f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.455814:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c108 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b15 expref: 35 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.455833:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161c00/0xc9a6a13d3cd1c10f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b15 expref: 34 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.455841:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:0.0:1788541206.455844:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541206.455848:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161c00, rc 0) 00000100:00100000:0.0:1788541206.455927:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adc2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+34:14536:x1875420945444096:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 334us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.455942:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 52 00000100:00100000:3.0:1788541206.466090:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.466201:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945444352 00000100:00100000:0.0:1788541206.466222:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945444352 00000100:00100000:0.0:1788541206.466286:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:0.0:1788541206.466297:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+34:14536:x1875420945444352:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541206.466383:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.466402:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.466445:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541206.466874:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788541206.466886:0:14430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491466476289ns, next at 492466474062ns, rc = 0 00000004:00010000:0.0:1788541206.466973:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f38a7cf reply state 000000006221f40c transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541206.466983:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541206.467073:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+36:14536:x1875420945444352:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 776us (991us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788541206.467080:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 53 00000100:00100000:3.0:1788541206.471527:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541206.471623:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945444480 00000100:00100000:1.0:1788541206.471634:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945444480 00000100:00100000:1.0:1788541206.471697:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 54 00000100:00100000:1.0:1788541206.471708:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+36:14536:x1875420945444480:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541206.471742:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541206.471762:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b1c expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.471821:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 37 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.471837:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 37 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.471882:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:1.0:1788541206.471886:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541206.471890:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd800, rc 0) 00000100:00100000:1.0:1788541206.471958:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+37:14536:x1875420945444480:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 251us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541206.471965:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 54 00010000:00010000:0.0:1788541206.472752:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.472763:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.472783:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.472789:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541206.472794:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.472802:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.472814:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:0.0:1788541206.472816:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788541206.472820:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.472827:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c116 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541206.477798:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.478207:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945444608 00000100:00100000:3.0:1788541206.478227:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945444608 00000100:00100000:3.0:1788541206.478289:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788541206.478299:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2359:x1875420945444608:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788541206.478691:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2359:x1875420945444608:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 392us (905us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788541206.478699:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:1.0:1788541206.491098:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.491242:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945444864 00000100:00100000:3.0:1788541206.491252:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945444864 00000100:00100000:3.0:1788541206.491309:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:3.0:1788541206.491318:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+36:14536:x1875420945444864:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788541206.491623:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+37:14536:x1875420945444864:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 304us (537us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788541206.491631:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 11 00000100:00100000:0.0:1788541206.499027:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541206.499208:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945445120 00000100:00100000:2.0:1788541206.499228:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945445120 00000100:00100000:2.0:1788541206.499285:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:2.0:1788541206.499295:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+37:14536:x1875420945445120:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541206.499459:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+37:14536:x1875420945445120:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 165us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541206.499468:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 55 00000100:00100000:1.0:1788541206.528136:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.530348:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945445248 00000100:00100000:0.0:1788541206.530363:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945445248 00000100:00100000:0.0:1788541206.530480:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:0.0:1788541206.530491:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+37:14536:x1875420945445248:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541206.530512:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541206.530533:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c124 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b23 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.530598:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1c12b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.530631:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1c12b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.530643:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1c12b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541206.530682:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788541206.530700:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1c12b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.530736:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160000/0xc9a6a13d3cd1c124 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b23 expref: 39 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.530755:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1c12b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b23 expref: 38 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.530763:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:0.0:1788541206.530766:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788541206.530770:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160e00, rc 0) 00000100:00100000:0.0:1788541206.530832:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+38:14536:x1875420945445248:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 343us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.530840:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 56 00000100:00100000:1.0:1788541206.538995:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.539089:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945445376 00000100:00100000:0.0:1788541206.539099:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945445376 00000100:00100000:0.0:1788541206.539155:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788541206.539164:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2358:x1875420945445376:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541206.539179:0:15591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541206.539206:0:15591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b2a expref: -99 pid: 15591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541206.539232:0:15591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af916, blocks: 0x1 00010000:00010000:0.0:1788541206.539250:0:15591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:0.0:1788541206.539254:0:15591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541206.539263:0:15591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 7 pid: 15591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.539282:0:15591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 7 pid: 15591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.539295:0:15591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae160000, rc 0) 00000100:00100000:0.0:1788541206.539345:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:2358:x1875420945445376:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 183us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.539353:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:1.0:1788541206.542500:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541206.542592:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945445632 00000100:00100000:2.0:1788541206.542600:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945445632 00000100:00100000:2.0:1788541206.542648:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:2.0:1788541206.542657:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+38:14536:x1875420945445632:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541206.542759:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+38:14536:x1875420945445632:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 103us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541206.542766:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 57 00000100:00100000:1.0:1788541206.547389:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.547534:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945445760 00000100:00100000:0.0:1788541206.547545:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945445760 00000100:00100000:0.0:1788541206.547607:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 58 00000100:00100000:0.0:1788541206.547619:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+38:14536:x1875420945445760:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788541206.681031:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+38:14536:x1875420945445760:12345-192.168.202.59@tcp:44:lhsmtool_posix.0 Request processed in 133403us (133640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.681045:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 58 00000001:00080000:3.0:1788541206.682376:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:3.0:1788541206.682385:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788541206.682435:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1788541206.682467:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:3.0:1788541206.684736:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541206.684762:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968495872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788541206.684833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541206.684924:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968495872 00000100:00100000:3.0:1788541206.684931:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968495872 00000100:00100000:2.0:1788541206.685267:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541206.685294:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945445888 00000100:00100000:2.0:1788541206.685298:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945445888 00000100:00100000:2.0:1788541206.685330:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1788541206.685339:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:2358:x1875420945445888:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788541206.685483:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:2358:x1875420945445888:12345-192.168.202.59@tcp:16:lhsmtool_posix.0 Request processed in 144us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541206.685490:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:3.0:1788541206.686605:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788541206.686618:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7adf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968495872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788541206.686807:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788541206.686810:0:15114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788541206.686812:0:15114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788541206.686814:0:15114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788541206 -> 1788541206 00002000:00010000:3.0:1788541206.686816:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788541206.686880:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7adf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875420968495872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 259us (2039us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788541206.686888:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788541206.686935:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98d7831b0700/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788541206.686943:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968495872:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788541206.687910:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541206.693576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.693755:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945446144 00000100:00100000:0.0:1788541206.693766:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945446144 00000100:00100000:0.0:1788541206.693842:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:0.0:1788541206.693854:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+13:14536:x1875420945446144:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541206.693923:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541206.693954:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160e00/0xc9a6a13d3cd1c12b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b23 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.693987:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:0.0:1788541206.693993:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541206.694024:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.694038:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.694047:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541206.694306:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024e2d33d reply state 00000000955269ee transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541206.694316:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541206.694480:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+14:14536:x1875420945446144:12345-192.168.202.59@tcp:36:lhsmtool_posix.0 Request processed in 628us (916us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788541206.694488:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 59 00000100:00100000:2.0:1788541206.698496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00010000:00010000:1.0:1788541206.698665:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.698679:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.698688:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.698695:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160600 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:1.0:1788541206.698700:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.698719:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.698754:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:1.0:1788541206.698758:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541206.698763:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.698770:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160600/0xc9a6a13d3cd1c139 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.699368:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945446272 00000100:00100000:3.0:1788541206.699379:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945446272 00000100:00100000:3.0:1788541206.699459:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:3.0:1788541206.699470:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:14536:x1875420945446272:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.699487:0:15116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541206.699505:0:15116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b31 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.699792:0:15116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.699803:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541206.699808:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541206.699814:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.699868:0:15116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.699894:0:15116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.699908:0:15116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15116:1875420968496000:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541206.700181:0:15116:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059240 going to sleep for 11 seconds 00000100:00100000:3.0:1788541206.714285:0:15116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15116:1875420968496000:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541206.714320:0:15116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.714341:0:15116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7bf4cd000, rc 0) 00000100:00100000:3.0:1788541206.714402:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:14536:x1875420945446272:12345-192.168.202.59@tcp:101:lhsmtool_posix.0 Request processed in 14934us (15915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541206.714446:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:2.0:1788541206.716953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541206.717054:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945446400 00000100:00100000:1.0:1788541206.717063:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945446400 00010000:00010000:1.0:1788541206.717103:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541206.717151:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:1.0:1788541206.717162:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:2358:x1875420945446400:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541206.717177:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541206.717201:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.717215:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.717249:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e35064e5/0xc9a6a13d3cd1c132 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b2a expref: 8 pid: 15591 timeout: 591 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.717266:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541206.717284:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541206.717293:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 7 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.717304:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 7 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.717343:0:14416:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 7 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541206.717358:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14416:1875420968496128:192.168.202.59@tcp:105: 00000100:00100000:1.0:1788541206.717485:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bf6946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541206.723668:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14416:1875420968496128:192.168.202.59@tcp:105: 00010000:00010000:1.0:1788541206.723695:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541206.723767:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:2358:x1875420945446400:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 6607us (6821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541206.723779:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:2.0:1788541206.724131:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.724749:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945446528 00000100:00100000:0.0:1788541206.724757:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945446528 00000100:00100000:0.0:1788541206.724807:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:0.0:1788541206.724818:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:2358:x1875420945446528:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788541206.725020:0:15591:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788541206.725037:0:15591:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788541205 00002000:00010000:0.0:1788541206.725039:0:15591:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788541203 00002000:00010000:0.0:1788541206.725042:0:15591:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788541206 -> 1788541205 00002000:00010000:0.0:1788541206.725044:0:15591:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788541206.725097:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:2358:x1875420945446528:12345-192.168.202.59@tcp:2:lhsmtool_posix.0 Request processed in 281us (967us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788541206.725106:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 17 00000100:00100000:2.0:1788541206.730273:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.730381:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945446656 00000100:00100000:3.0:1788541206.730392:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945446656 00000100:00100000:3.0:1788541206.730486:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:3.0:1788541206.730498:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:2359:x1875420945446656:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.730792:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.730831:0:15114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.730840:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541206.730844:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541206.730850:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.730950:0:15114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 8 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.730966:0:15114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 8 pid: 15116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.730981:0:15114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15114:1875420968496256:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541206.731100:0:15114:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059240 going to sleep for 11 seconds 00000100:00100000:1.0:1788541206.740217:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541206.740323:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945446784 00000100:00100000:2.0:1788541206.740333:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945446784 00010000:00010000:2.0:1788541206.740450:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 9 pid: 15116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541206.740492:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:2.0:1788541206.740502:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:2359:x1875420945446784:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541206.740518:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541206.740552:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 9 pid: 15116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.740567:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 9 pid: 15116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.740591:0:14417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541206.740596:0:14417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541206.740601:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.740612:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.740634:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541206.740685:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+9:2359:x1875420945446784:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 185us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541206.740693:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:3.0:1788541206.741824:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055389829/0xc9a6a13d3cd1c140 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b31 expref: 8 pid: 15116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.741842:0:15114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15114:1875420968496256:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541206.741863:0:15114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741884:0:15114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741901:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741929:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741938:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741945:0:15114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741951:0:15114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541206.741956:0:15114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741965:0:15114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741978:0:15114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.741986:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8382ce5/0xc9a6a13d3cd1c147 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.742070:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:2359:x1875420945446656:12345-192.168.202.59@tcp:1:lhsmtool_posix.0 Request processed in 11574us (11805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541206.742079:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 18 00000100:00100000:1.0:1788541206.755508:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.755905:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945447040 00000100:00100000:3.0:1788541206.755915:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945447040 00000100:00100000:3.0:1788541206.755974:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 60 00000100:00100000:3.0:1788541206.755984:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+13:14536:x1875420945447040:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788541206.756059:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756075:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756087:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756635:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756649:0:16301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756659:0:16301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756693:0:16301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.756731:0:16301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 14 pid: 14432 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.756746:0:16301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968496384:192.168.202.59@tcp:104: 00000100:00100000:3.0:1788541206.756891:0:16301:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059240 going to sleep for 11 seconds 00000100:00100000:2.0:1788541206.765031:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.765401:0:16301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968496384:192.168.202.59@tcp:104: 00010000:00010000:3.0:1788541206.765461:0:16301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541206.765878:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945447168 00000100:00100000:1.0:1788541206.765886:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945447168 00010000:00010000:1.0:1788541206.765923:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 15 pid: 14432 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541206.765960:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 16 00000100:00100000:1.0:1788541206.765971:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+15:2358:x1875420945447168:12345-192.168.202.59@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541206.766002:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541206.766010:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 15 pid: 14432 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.766022:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 15 pid: 14432 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.766042:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7999bd800/0xc9a6a13d3cd1c11d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b1c expref: 15 pid: 14432 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.766058:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:1.0:1788541206.766064:0:14416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.766073:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.766080:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.766108:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541206.766162:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+14:2358:x1875420945447168:12345-192.168.202.59@tcp:103:ldlm_bl.0 Request processed in 193us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541206.766169:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 16 00010000:00010000:3.0:1788541206.767991:0:16301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.768007:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541206.768202:0:16301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788541206.768819:0:16301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788541206.768860:0:16301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788541206.768939:0:16301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16301:1875420968496512:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788541206.769000:0:16301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541206.769151:0:16301:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541206.775158:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968496512 00000100:00100000:0.0:1788541206.775173:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968496512 00000100:00100000:0.0:1788541206.775245:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541206.775257:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16301:x1875420968496512:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541206.776723:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16301:x1875420968496512:12345-0@lo:1000:mdt00_003.0 Request processed in 1452us (7707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.776735:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788541206.780070:0:16301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7ada10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16301:1875420968496512:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788541206.781328:0:16301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788541206.781674:0:16301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16301:1875420968496640:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541206.781769:0:16301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541206.781835:0:16301:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d7bb519480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541206.782774:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968496640 00000100:00100000:3.0:1788541206.782785:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968496640 00000100:00100000:3.0:1788541206.782868:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541206.782960:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:16301:x1875420968496640:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788541206.783167:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:16301:x1875420968496640:12345-0@lo:1000:mdt00_003.0 Request processed in 211us (1398us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788541206.783346:0:16301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16301:1875420968496640:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788541206.783696:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783715:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783723:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783729:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cd000 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541206.783734:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783743:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783758:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:2.0:1788541206.783761:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541206.783766:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783772:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd000/0xc9a6a13d3cd1c155 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783801:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783814:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783820:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783825:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:2.0:1788541206.783828:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783833:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783841:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:2.0:1788541206.783843:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541206.783850:0:16301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.783861:0:16301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541206.783960:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788541206.784027:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541206.784083:0:16301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cd800/0xc9a6a13d3cd1c0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b00 expref: 17 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541206.784095:0:16301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968496768:192.168.202.59@tcp:105: 00000100:00100000:2.0:1788541206.784207:0:16301:0:(client.c:2716:ptlrpc_set_wait()) set ffff98d791059f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541206.788178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.788251:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945447296 00000100:00100000:0.0:1788541206.788260:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945447296 00000100:00100000:0.0:1788541206.788317:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:0.0:1788541206.788328:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+18:14535:x1875420945447296:12345-192.168.202.59@tcp:49:bash.0 00000100:00100000:0.0:1788541206.788491:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+18:14535:x1875420945447296:12345-192.168.202.59@tcp:49:bash.0 Request processed in 165us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.788498:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 12 00000100:00100000:3.0:1788541206.791269:0:16301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16301:1875420968496768:192.168.202.59@tcp:105: 00010000:00010000:3.0:1788541206.791300:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791312:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160400/0xc9a6a13d3cd1c0ad lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791350:0:16301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791376:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791389:0:16301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791400:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791429:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791437:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791443:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cca00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.791448:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791455:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791483:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:3.0:1788541206.791487:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541206.791491:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791497:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cca00/0xc9a6a13d3cd1c15c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791508:0:16301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791515:0:16301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791520:0:16301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791533:0:16301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7bf4cc400 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:3.0:1788541206.791536:0:16301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791542:0:16301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791550:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:3.0:1788541206.791553:0:16301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541206.791556:0:16301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.791562:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7bf4cc400/0xc9a6a13d3cd1c14e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16301 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541206.791988:0:14464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788541206.791993:0:14464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541206.792017:0:14464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788541206.792023:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788541206.792841:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+17:14536:x1875420945447040:12345-192.168.202.59@tcp:57:lhsmtool_posix.0 Request processed in 36852us (37338us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788541206.792852:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 60 00000020:00080000:3.0:1788541206.792858:0:16301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788541206.793042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541206.795165:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.795444:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945447680 00000100:00100000:0.0:1788541206.795456:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945447680 00000100:00100000:0.0:1788541206.795508:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 13 00000100:00100000:0.0:1788541206.795518:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+17:14536:x1875420945447680:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788541206.797096:0:14433:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788541206.797205:0:14433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1788541206.797519:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.797648:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.797661:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.797671:0:14433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.797677:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.797684:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.797753:0:14433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788541206.797864:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14536:x1875420945447680:12345-192.168.202.59@tcp:35:lhsmtool_posix.0 Request processed in 2344us (2702us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1788541206.797882:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 13 00000020:00080000:0.0:1788541206.797888:0:14433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788541206.798183:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945447424 00000100:00100000:1.0:1788541206.798201:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945447424 00000100:00100000:1.0:1788541206.798269:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 19 00000100:00100000:1.0:1788541206.798280:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+7:14535:x1875420945447424:12345-192.168.202.59@tcp:101:bash.0 00010000:00010000:1.0:1788541206.798294:0:15591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541206.798311:0:15591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1c16a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b38 expref: -99 pid: 15591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541206.798334:0:15591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9af915, atime: 0x6a9af913, ctime: 0x6a9af915, blocks: 0x1 00010000:00010000:1.0:1788541206.798352:0:15591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=491s v=(0 0) 00010000:00010000:1.0:1788541206.798357:0:15591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541206.798377:0:15591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1c16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b38 expref: 8 pid: 15591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.798392:0:15591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc2bac55/0xc9a6a13d3cd1c16a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b38 expref: 8 pid: 15591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541206.798404:0:15591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7999bd400, rc 0) 00000100:00100000:1.0:1788541206.798447:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:14535:x1875420945447424:12345-192.168.202.59@tcp:101:bash.0 Request processed in 170us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541206.798453:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 19 00010000:00010000:3.0:1788541206.802149:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541206.802163:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.802174:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160200 already unused, calling callback (ffffffffc15a34f0) 00010000:00010000:3.0:1788541206.802179:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.802188:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.802206:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff98d783b8b500) 00010000:00010000:3.0:1788541206.802219:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788541206.802224:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.802231:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160200/0xc9a6a13d3cd1c163 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541206.802255:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541206.802257:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541206.802259:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541206.803287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.803442:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945447936 00000100:00100000:0.0:1788541206.803452:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945447936 00000100:00100000:0.0:1788541206.803509:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 14 00000100:00100000:0.0:1788541206.803519:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+19:14535:x1875420945447936:12345-192.168.202.59@tcp:35:bash.0 00000001:00080000:0.0:1788541206.804051:0:14433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788541206.804160:0:14433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788541206.804273:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+22:14535:x1875420945447936:12345-192.168.202.59@tcp:35:bash.0 Request processed in 754us (990us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788541206.804282:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 14 00000020:00080000:0.0:1788541206.804287:0:14433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788541206.935756:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541206.948188:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.951137:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945448192 00000100:00100000:0.0:1788541206.951152:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945448192 00000100:00100000:0.0:1788541206.951639:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:0.0:1788541206.951651:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+22:14546:x1875420945448192:12345-192.168.202.59@tcp:101:lfs.0 00010000:00010000:0.0:1788541206.951675:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541206.951696:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3273614c8ac1b3f expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541206.951814:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788541206.951955:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c171 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b3f expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.951969:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98d783b8b700) 00010000:00010000:0.0:1788541206.951973:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541206.951978:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.59@tcp remote: 0x3273614c8ac1b3f expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.951993:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98d7ae161200, rc 0) 00000100:00100000:0.0:1788541206.952064:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14546:x1875420945448192:12345-192.168.202.59@tcp:101:lfs.0 Request processed in 415us (3887us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788541206.952071:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 61 00000100:00100000:1.0:1788541206.964744:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541206.966648:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945448320 00000100:00100000:0.0:1788541206.966675:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945448320 00000100:00100000:0.0:1788541206.966805:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:0.0:1788541206.966817:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14546:x1875420945448320:12345-192.168.202.59@tcp:34:lfs.0 00010000:00010000:0.0:1788541206.966920:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.966938:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.966950:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.966966:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.966973:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.966980:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.967222:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.967231:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.967249:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541206.969059:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969098:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969105:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969113:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969119:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161200 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541206.969123:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969131:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969144:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff98d786553200) 00010000:00010000:0.0:1788541206.969146:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541206.969151:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969157:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161200/0xc9a6a13d3cd1c17f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969172:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969178:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969185:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969648:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae160a00 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541206.969652:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969659:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969668:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff98d783b8b400) 00010000:00010000:0.0:1788541206.969670:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541206.969673:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969679:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae160a00/0xc9a6a13d3cd1c186 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969694:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969701:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969718:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969723:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98d7ae161800 already unused, calling callback (ffffffffc1fe74f0) 00010000:00010000:0.0:1788541206.969726:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969731:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.969752:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff98d783b8b300) 00010000:00010000:0.0:1788541206.974026:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541206.974038:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541206.974050:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98d7ae161800/0xc9a6a13d3cd1c18d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541206.974165:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14546:x1875420945448320:12345-192.168.202.59@tcp:34:lfs.0 Request processed in 7346us (9426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541206.974175:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 62 00000100:00100000:1.0:1788541206.979803:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541206.979917:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945448576 00000100:00100000:2.0:1788541206.979929:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945448576 00000100:00100000:2.0:1788541206.979981:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 15 00000100:00100000:2.0:1788541206.979991:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+23:14546:x1875420945448576:12345-192.168.202.59@tcp:35:lfs.0 00000100:00100000:2.0:1788541206.980224:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+24:14546:x1875420945448576:12345-192.168.202.59@tcp:35:lfs.0 Request processed in 234us (430us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788541206.980232:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 15 00010000:00010000:3.0:1788541207.962008:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541208.023666:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968497280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541208.023747:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541208.023815:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541208.023835:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968497152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541208.023869:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541208.023905:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497280 00000100:00100000:1.0:1788541208.023911:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497280 00000100:00100000:1.0:1788541208.023950:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541208.023957:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968497280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541208.024000:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875420968497280:12345-0@lo:400:kworker.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541208.024006:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541208.024038:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875420968497280:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024254:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968497024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024296:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541208.024315:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968497536:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024331:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541208.024344:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788541208.024349:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968496896:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024382:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541208.024399:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968497408:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024439:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541208.024460:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968496896 00000100:00100000:3.0:1788541208.024463:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968496896 00000100:00100000:3.0:1788541208.024487:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541208.024492:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968496896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024520:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e59d638-365e-4b5a-a31c-1933ab9279a7+19:3317:x1875420968496896:12345-0@lo:400:kworker.0 Request processed in 28us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541208.024526:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541208.024556:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e59d638-365e-4b5a-a31c-1933ab9279a7:3317:1875420968496896:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024571:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497152 00000100:00100000:3.0:1788541208.024574:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497152 00000100:00100000:3.0:1788541208.024601:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497024 00000100:00100000:3.0:1788541208.024603:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497024 00000100:00100000:3.0:1788541208.024618:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541208.024624:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968497152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024652:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875420968497152:12345-0@lo:400:kworker.0 Request processed in 28us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541208.024658:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541208.024666:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788541208.024677:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875420968497024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024717:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1875420968497024:12345-0@lo:400:kworker.0 Request processed in 40us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541208.024722:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788541208.024736:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541208.024740:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541208.024756:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1875420968497024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024787:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d68130b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1875420968497152:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024804:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497536 00000100:00100000:3.0:1788541208.024806:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497536 00000100:00080000:3.0:1788541208.024818:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541208.024835:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497408 00000100:00100000:3.0:1788541208.024837:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497408 00000100:00100000:3.0:1788541208.024851:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541208.024856:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968497536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024894:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875420968497536:12345-0@lo:400:kworker.0 Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541208.024900:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541208.024908:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788541208.024914:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968497408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024933:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875420968497408:12345-0@lo:400:kworker.0 Request processed in 20us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541208.024938:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788541208.024947:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541208.024959:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1875420968497408:0@lo:400:kworker.0 00000100:00100000:3.0:1788541208.024966:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d681308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1875420968497536:0@lo:400:kworker.0 00000100:00100000:2.0:1788541208.026591:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7831b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968497664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541208.026643:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541208.026682:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497664 00000100:00100000:2.0:1788541208.026687:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497664 00000100:00100000:2.0:1788541208.026739:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541208.026746:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7831b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968497664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541208.026790:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788541208.026836:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7831b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875420968497664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541208.026843:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541208.061071:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7831b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968497664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541208.540962:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541208.540988:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff98d7b2f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968497792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541208.541055:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541208.541113:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420968497792 00000100:00100000:1.0:1788541208.541120:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420968497792 00000100:00100000:1.0:1788541208.541165:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788541208.541174:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968497792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541208.541802:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788541208.542008:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875420968497792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 833us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541208.542017:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541208.542040:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff98d7b2f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1875420968497792:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788541208.610508:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1788541208.610525:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:3.0:1788541208.983560:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541209.250194:0:16695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:1.0:1788541209.734718:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541209.734776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541209.734897:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945448704 00000100:00100000:2.0:1788541209.734908:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945448704 00002000:00100000:2.0:1788541209.734979:0:15119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff98d681308a80 x1875420945448704/t0(0) o4->0672894e-cb1f-4a3b-ac8b-b30216598b4a@192.168.202.59@tcp:580/0 lens 504/0 e 0 to 0 dl 1788541220 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788541209.735011:0:15119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d681308a80 with x1875420945448704 ext(0->8) 00002000:00010000:2.0:1788541209.735017:0:15119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98d681308a80 00000100:00100000:2.0:1788541209.735054:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 0 00000100:00100000:2.0:1788541209.735066:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2359:x1875420945448704:12345-192.168.202.59@tcp:4:bash.0 00000100:00080000:0.0:1788541209.735345:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541209.735665:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:2359:x1875420945448704:12345-192.168.202.59@tcp:4:bash.0 Request processed in 600us (956us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788541209.735674:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 0 00002000:00100000:2.0:1788541209.735692:0:15119:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff98d681308a80 x1875420945448704/t8589934598(0) o4->0672894e-cb1f-4a3b-ac8b-b30216598b4a@192.168.202.59@tcp:580/0 lens 504/448 e 0 to 0 dl 1788541220 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788541209.735702:0:15119:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff98d681308a80 with x1875420945448704 ext(0->8) 00002000:00010000:2.0:1788541209.735705:0:15119:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98d681308a80 00000100:00100000:3.0:1788541209.742102:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945448832 00000100:00100000:3.0:1788541209.742118:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945448832 00000100:00100000:2.0:1788541209.743221:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 20 00000100:00100000:2.0:1788541209.743233:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:2359:x1875420945448832:12345-192.168.202.59@tcp:16:kworker.0 00000100:00100000:3.0:1788541209.869159:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0672894e-cb1f-4a3b-ac8b-b30216598b4a+8:2359:x1875420945448832:12345-192.168.202.59@tcp:16:kworker.0 Request processed in 125917us (134371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541209.869173:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 20 00000001:00080000:1.0:1788541209.869442:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000040:00080000:0.0:1788541209.879990:0:14464:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788541209.880000:0:14464:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541209.880058:0:14464:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788541209.880064:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788541210.007774:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541210.241503:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541210.241569:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541210.241606:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:3.0:1788541210.241727:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945449216 00000100:00100000:3.0:1788541210.241737:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945449216 00000100:00100000:3.0:1788541210.241785:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1788541210.241795:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d681308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2359:x1875420945449216:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:3.0:1788541210.241877:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d681308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+6:2359:x1875420945449216:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541210.241884:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:0.0:1788541210.242537:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945448960 00000100:00100000:0.0:1788541210.242543:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945448960 00000100:00100000:0.0:1788541210.242587:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:0.0:1788541210.242594:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b611e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:2359:x1875420945448960:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:0.0:1788541210.242621:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b611e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54f362de-fc37-4008-b51a-09fbe19369bd+13:2359:x1875420945448960:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 29us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541210.242626:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 123 00000100:00100000:2.0:1788541210.243177:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945449088 00000100:00100000:2.0:1788541210.243195:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945449088 00000100:00100000:2.0:1788541210.243264:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00100000:2.0:1788541210.243273:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d68130b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+24:2359:x1875420945449088:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541210.243320:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d68130b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0672894e-cb1f-4a3b-ac8b-b30216598b4a+24:2359:x1875420945449088:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 49us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541210.243327:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 31 00000100:00080000:0.0:1788541210.243468:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541210.251109:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541210.251150:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:0.0:1788541210.251192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:1.0:1788541210.251354:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945449344 00000100:00100000:1.0:1788541210.251364:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945449344 00000100:00100000:1.0:1788541210.251441:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945449600 00000100:00100000:1.0:1788541210.251444:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945449600 00000100:00100000:1.0:1788541210.251458:0:15591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945449728 00000100:00100000:1.0:1788541210.251460:0:15591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945449728 00000100:00100000:1.0:1788541210.251475:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1788541210.251484:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+5:2357:x1875420945449344:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:1.0:1788541210.251529:0:15591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1be22 00000100:00080000:1.0:1788541210.251546:0:15591:0:(import.c:65:import_set_state_nolock()) ffff98d682cf6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541210.251582:0:15591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00080000:0.0:1788541210.252114:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541210.252119:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541210.254096:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:2.0:1788541210.254119:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2357:x1875420945449600:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:2.0:1788541210.254160:0:15114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1be53 00000100:00080000:2.0:1788541210.254179:0:15114:0:(import.c:65:import_set_state_nolock()) ffff98d7bef65800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541210.254240:0:15114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1788541210.255147:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0672894e-cb1f-4a3b-ac8b-b30216598b4a+2:2357:x1875420945449344:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 3657us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541210.255158:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 21 00000100:00100000:1.0:1788541210.255186:0:15591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 23 00000100:00100000:1.0:1788541210.255195:0:15591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+5:2357:x1875420945449728:12345-192.168.202.59@tcp:9:kworker.0 00000020:00000080:1.0:1788541210.255215:0:15591:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc9a6a13d3cd1be5a 00000100:00080000:1.0:1788541210.255222:0:15591:0:(import.c:65:import_set_state_nolock()) ffff98d682f57800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788541210.255697:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541210.256996:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541210.257007:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788541210.257097:0:15591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788541210.257558:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+2:2357:x1875420945449600:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 3444us (6401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541210.257569:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 22 00000100:00100000:3.0:1788541210.259105:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.59@tcp (source: 12345-192.168.202.59@tcp) 00000100:00100000:2.0:1788541210.276956:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420945449472 00000100:00100000:2.0:1788541210.276972:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420945449472 00000100:00100000:2.0:1788541210.277071:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00100000:2.0:1788541210.277083:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2359:x1875420945449472:12345-192.168.202.59@tcp:400:kworker.0 00000100:00100000:2.0:1788541210.277165:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7ada12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f5d45147-30f1-4e88-b8e5-74d4c60304c2+6:2359:x1875420945449472:12345-192.168.202.59@tcp:400:kworker.0 Request processed in 84us (18066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541210.277173:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 32 00000100:00080000:0.0:1788541210.277272:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541210.281274:0:15591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98d7b2f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f5d45147-30f1-4e88-b8e5-74d4c60304c2+2:2357:x1875420945449728:12345-192.168.202.59@tcp:9:kworker.0 Request processed in 26067us (30067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541210.281290:0:15591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.59@tcp, seq: 23 00010000:00010000:0.0:1788541211.035082:0:15589:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788541211.724011:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000001:00080000:3.0:1788541211.724045:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788541211.724056:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff98d7bb519000 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1788541211.724062:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff98d7bb519900 00000020:00080000:3.0:1788541211.724066:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff98d7b5120b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff98d681d5d000 00000020:00080000:3.0:1788541211.724079:0:14468:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:3.0:1788541211.724508:0:14468:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 Debug log: 29795 lines, 29795 kept, 0 dropped, 0 bad.